On a pairing of Goldberg-Shahidi for even orthogonal groups 

Wen- Wei Li 

Abstract 

Let TT Kl cr be a supercuspidal representation of GL{2n) x S0(2n) over a p-adic field with 

71" selfdual, wliere S0(2n) stands for a quasisplit even special orthogonal group. In order to 

study its normalized parabolic induction to S0(6ri), Goldberg and Shahidi defined a pairing 

R between the matrix coefficients of tt and a which controls the residue of the standard 

f ^ , intertwining operator. The elliptic part _RcU of R is conjectured to be related to twisted 

^SJ ' endoscopic transfer. Based on Arthur's endoscopic classification and Spallone's improvement 

^ , of Goldberg-Shahidi program, we will verify some of their predictions for general n, under 

C^ ' the assumption that vr does not come from S0(2n + 1). 

Contents 

Contents [l] 



m 



H 

"^ . 1 Introduction 



a 



2 Notations and conventions 



4.4 Geometric transfer factors of G = SO(y, q) 

4.5 Geometric transfer 

Crude local Langlands correspondence for orthogonal groups 

5.1 Selfdual L-parameters 

5.2 Spectral transfer 

5.3 Character relations 



-^ ■ 3 Twisted harmonic analysis 

^ , 3.1 General notions 

'^ [ 3.2 Some structm'e theory 

3.3 Representations 

■^ . 3.4 Orbital integrals 

(^ [ 3.5 Relation to non-connected groups 

O ■ 3.6 Example: GLe{N) 

^^ ' — 

4 Twisted endoscopy for GL(2n) [13 

4.1 GL(2n) and its elliptic endoscopic data 

^ . 4.2 Correspondence of very regular classes 

j^ I 4.3 A separation lemma 



13 

15 
19 
20 
24 



27 
28 
3C 



6 The Goldberg-Shahidi-Spallone formalism 

6.1 Sesquilinear algebra 

6.2 GS-norms 

6.3 Transfer factor in the even orthogonal case 

6.4 Goldberg-Shahidi pairing 

6.5 The pairing for even orthogonal groups . . . 



33 
35 

38 
39 

42 



References 43 



1 Introduction 

History The residue of intertwining operators plays a pivotal role in the study of non- 
discrete tempered spectrum of reductive groups over local fields. To be precise, let F be a 
non-archimedean local field of characteristic zero, and consider a quasisplit classical group Gi 
together with a maximal proper Levi subgroup of the form M := GL{H) x G, where H is 
some F- vector space and G is a classical group of the same type as Gi. Choose a parabolic 
subgroup P = MU . Let Xp(7r M a) be the normalized parabolic induction, where vr Kl o" is an 
essentially square-integrable irreducible representation of M{F). To study its reducibility, one 
may assume vr to be selfdual. After Harish-Chandra, the problem is reduced to the study of the 
residue at A = of the standard intertwining operator Jp{wo, (vr M a)\) for Ip{{tt K1 cr)x), where 
vr Kl o" I— )• (vr Kl (t)a means the twist by the unramified character M(F) attached to A G ^mc 
and wq is a suitable element in Nq^(^p-^{M{F)). 

In the case of split even orthogonal groups and supercuspidal tt M a, Shahidi introduced 
a notion of norm correspondence in [27J that relates conjugacy classes between Gh{H) and G 
(baptized GS-norm in this article). Using a lemma of Rallis [261 Lemma 4.1], he showed that 
Resx=oJp{wo, {■KMa)x) is actually governed by a pairing R between matrix coefficients of vr and 
o". The main idea is to decompose U into M-orbits. This method is polished and generalized to 
other classical groups in a series of papers by Goldberg and Shahidi [8l[9l[T0]. Later on, Spallone 
rewrote R as a "weighted integral" of matrix coefficients, and gave an amended formula in 
|301 |3T] . Recently, a broader interpretation in the context of generalized functionals and Bessel 
functions is given in [7, §6.3]. 

In either formulation, R can be written as the sum of a regular, or elliptic term R^w and a 
singular term -Rging- The term R^^n can be expressed as an integral pairing between the character 
of a and some twisted character of vr. Shahidi conjectured that the nonvanishing of i?cii should 
be closely related to twisted endoscopy for GL{H), as developed in [T7| . 

The reducibility of Xp(vr Kl a) can be determined by Arthur's results [3l §6.6] nowadays. 
Nevertheless, some conjectures about i?eii remain unanswered. Let us explain. 

We will concentrate on the case Gi = SO(Vi,gi), G = SO{V,q) where (Vi,gi) and {V,q) 
are even-dimensional -F-quadratic spaces, such that diuip V = diuip H = 2n, i.e. M consists of 
matrices of "three equal-sized blocks". We exclude the case SO{V,q) ~ GL(1). The pairing i?eii 
essentially takes the form 

X; \WiSOiV,q),T{F))\'' I lSO(^.5)(cT,7)/^(^)(vf,5)d7, 

r:elliptic T(F) 

/conjugation 

where 

• / ^ '"^^(o", 7) is the normalized character of a; 

• I^'^'^)(vf, 6) is the normalized twisted character of vr; 



J >-^ 5 is a section for GS-norm. 



For further explanations, see §631 

This looks like the elliptic inner product for square-integrable representations O Theorem 3] , 
but the groups here are different, and a twist intervenes. Shahidi made the following definition 
(sic): a supercuspidal selfdual representation vr of Gh(H) is called a twisted endoscopic transfer 
of a supercuspidal representation a of SO(y, g), if the pairing i?eii for vr Kl a is not identically 
zero. This is [3 Definition 5.1]. 

Indeed, Goldberg and Shahidi have shown that the GS-norm is compatible with the norm 
mapping in twisted endoscopy, defined by Kottwitz and Shelstad in [17^ §3]. On the other hand, 
the Langlands-Shahidi method via L-functions also gives some evidence for this definition when 
a is generic; see [SI §5]. The connection remains conjectural, however, until the emergence of 
[29j . Let Wjr denote the central character of vr. In the case n = 1 and SO{V,q) = E^ := {x £ 
E^ : N^ip{x) = 1} where E/F is a quadratic extension, Shahidi and Spallone showed that 

• if Wtt = 1, then i?ell is not identically zero for all vr and a] 

• if c^Jtt 7^ 1) then i?eii is not identically zero if and only if vr is attached to Ind^/p((T) (the 
local automorphic induction), where a is regarded as a representation oi E^ via the usual 
surjection E^ — )■ E^. 

The proof of the first assertion is a direct calculation using Shimizu's explicit character formulae, 
while that of the second assertion relies upon the character identities of Labesse-Langlands, 
which amounts to the twisted endoscopy for GL(2) (cf. [T71 §5.3]). One of their key observations 
is that the Labesse-Langlands transfer factor A(7, 5) is independent of 5^ provided that 7 and 
5 are related by GS-norm. Also note that 0;,^ = 1 if and only if vr comes from PGL(2) = S0(3). 

Goal of this article We consider similar problems for general GL(i7) and SO(y, g) with 
dirui;' H = d\ra.p V = 2n, under the Hvpothesis 16. 5.11 that vr does not come from S0(2n-|- 1) (the 
split form) by twisted endoscopic transfer. The main impetus comes from Arthur's monumental 
work [3], which provides the necessary local Langlands correspondence and twisted character 
relations. Our main result is Theorem 16.5.21 that reconciles Shahidi's definition and Arthur's 
endoscopic classification for SO(F, g). 

The implications in number theory and harmonic analysis can be understood in terms of 
L-functions: 



nonvanishing of 

R = ReW + -Rsing 



pole at A = of 

Jp(u'o,(vrKa)A)f 



pole at s = of 

L(s,vr X cr)L(2s,vr, A^) 



the rightmost arrow comes from Langlands' conjecture on the normalization of intertwining 
operators, which is also a good vehicle for studying such L-functions as illustrated in [281 
Chapter 8] for generic inducing data. In view of our result, the nonvanishing of i?eii should 
point to a pole of the Rankin-Selberg L-function L{s^ vr x cr) at s = 0, provided that the exterior 
square L-function L(s, vr,A^) is holomorphic at s = 0. Cf. [5]. 

The idea of the proof is to apply the endoscopic character relations, then use Schur's orthog- 
onality relations on SO(y, g). This does not follow from [3] for free since the twisted transfer 
factor A(7,(^) intervenes. Let us explain the bottlenecks. 

1. Instead of the language of [T7], we adopt Labesse's notion of twisted spaces [18] systemat- 
ically. That is, we will do the harmonic analysis on the GL(i/)-bitorsor of non-degenerate 
bilinear forms on H, or equivalently the space Isom(i7, i7^), denoted by Gl-i[H). 



2. Following [3T], the Goldberg-Shaliidi-Spallone formalism is reformulated in a basis- free 
way. The twisted space GL(H) comes out naturally from this perspective. One also 
obtains a transparent description of GS-norms for very regular classes. 

3. Unlike some other applications of endoscopy, knowing the formal properties of transfer 
factors does not suffice. The key ingredient comes from Waldspurger's elegant formula 
[37] of the transfer factor A for SO(y, q), viewed as an elliptic endoscopic group of GL{H). 
Once the twisted paraphrase of Goldberg-Shahidi-Spallone formalism is in place, it will 
follow easily that A only depends on {V, q). 

The applicability of Waldspurger's formula is inextricably liked with the first two points. As a 
consequence, our notations will deviate somehow from those of [3 |9l [lOl [29l [31] . We hope the 
reader will be convinced of the flexibility of twisted spaces, especially in the context of classical 
groups of higher rank. 

In this article, we restrict ourselves to the elliptic terms in Goldberg-Shahidi or Spallone's 
formula for R. This is certainly unsatisfactory. If the non-elliptic terms in R can be expressed 
in terms of Arthur's weighted orbital integrals, as alluded in [29j, then the endoscopic character 
relations obtained in ^ might still be applicable by invoking [1]. 

Structure of this article In ^ we set up the basic terminologies, including the conventions 
of quadratic and hermitian forms that will be heavily used in ^ 

Due to the temporary lack of a comprehensive exposition on Labesse's notion of twisted 
spaces, we collect some basic notions and results in ^ Although we will only encounter the 
twisted space of bilinear or sesquilinear forms, a general introduction seems profitable. The 
main sources are [Ml [20] • 

In 21 we review the geometric aspect of twisted endoscopy for GL(2n) in the spirit of [3j. 
The emphasis is put on the simple endoscopic groups SO{V,q) where dim V = 2n. Nevertheless, 
it seems more reasonable, and not too laborious, to include the other elliptic endoscopic data 
as well. In order to use Waldpsurger's formulae |37J, we also need to parametrize conjugacy 
classes in terms of linear algebra and calculate some invariants attached to regular nilpotent 
orbits. After these aperitifs, we are able to state the formula for geometric transfer factors in 
^4.41 We will also prove the Lemma 14.3.1 1 that supersedes |29^ Proposition 8]. 

In ^ we review the spectral aspect of twisted endoscopy. After a recollection of Arthur's 
central results, we give a formula of character values at elliptic classes. The idea of using Weyl 
integration formula to relate character values is certainly well-known, however the twisted case 
has not been worked out in detail. We will give a proof in the spirit of |2]. Note that we only 
need the crude version of local Langlands correspondence for square-integrable representations 
of SO(y, q), that describes the representations only up to 0{V, q). Indeed, the Goldberg-Shahidi 
pairing is equally "crude" in this respect. 

The formalism of Goldberg-Shahidi-Spallone is reformulated in ^Si for classical groups in 
general. Using the parametrization of very regular classes, we are able to relate GS-norms and 
the correspondence in ^37j directly. As an easy corollary, we prove the constancy of transfer 
factors for elements 7, 6 that are related via GS-norm, in the even orthogonal case. We give 
a rapid review of the elliptic term of Goldberg-Shahidi pairing R in ^6.4[ What we consider is 
actually the pairing R defined in (|30p that is proportional to the i?eii in Spallone's formula. 
Using the aforementioned results. Theorem 16.5.21 follows immediately. See Remark 16.5.31 for the 
non-quasisplit cases. 

Some statements in this article are evidently more general then needed. This is done inten- 
tionally, in the hope that they inight be useful for further generalizations. 
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2 Notations and conventions 

Local fields Unless otherwise specified, F denotes a non-archimedean local field of character- 
istic zero with a fixed uniformizer zup. Let Op, pp be the ring of integers of -F and its maximal 
ideal, respectively, and let qp be the cardinality of Op/pp. Denote by | • | the normalized absolute 
value on F. Fix an algebraic closure F of F. We will denote by Tp its absolute Galois group, 
Wp its Weil group, and WBp := Wp x SU(2) its Weil-Deligne group. 

Throughout this article, we fix an additive unitary character ipp : F — t- C^. 

Let L/F be a finite extension. We will write N^ip and ti ^ip for the norm and trace, 
respectively. More generally, if L is an etale F-algebra of finite dimension, we can still define 
Np/p and iri/F- 

Group theory By F-group we mean a group variety over F. For any F-group H^ denote 
by H° its identity connected component, and H{F) denotes the set of F-points of H^ equipped 
with the topology induced by F. By a subgroup of H we mean a closed F-subgroup, unless 
otherwise specified. The normalizers in H (resp. centralizers) will be denoted by Nh{-) (resp. 
Zni:)) ^'^d the center of H will be denoted by Zh- The adjoint action by an element x is 
denoted by Ad2:(-)- The same notations pertain to topological groups. Fraktur letters are used 
to denote Lie algebras. 

Let (tt, V) be a smooth representation of a locally profinite group, its contragredient repre- 
sentation is denoted by (7r^,y^). 

Hermitian spaces Consider a pair {E,t), where E is a field of characteristic 7^ 2 and r is 
an involution of E. For a finite-dimensional i?-vector space V, define its hermitian dual as the 
E-vectoi space 

y^ ■.= ^RomE{V,E), 

where the superscript ^ means that its scalar multiplication -k is twisted: a-kX := r(a)A for all 
a £ E, X £ V"^ . We have the canonical isomorphism V — )■ V'^'^ , namely v 1— )■ t{{-,v)). We shall 
always identify V and F^^ without further remarks. 

For X G Hom£;(T/i, V2), its hermitian transpose is denoted by A G Hom£;(V2^, y^^), charac- 
terized by (t'2, Awi) = {Xv2,'>^i)- 

By a (E, r)-sesquilinear form on V, we mean a bi-additive map q : V x V ^ E such that 
q{av\l3v') = T{a)q{v\v')l3 for all a,l3 £ E, v,v' G V. The (-E, r)-sesquilinear forms on V are 
in bijection with elements in Isom£;(y, y^): to a : V ^ V"^ we attach the sesquilinear form 
q{v\v') = {a{v),v'). 

Let g be a sesquilinear form on V, its transposed form *g is defined by {v,v') 1— )■ T{q{v'\v)). 

Let e = ±1, a (i?, r)-hermitian form of sign e on F is a non-degenerate (i?, r)-sesquilinear 
form q such that *g = eq. We also call {V, q) a {E, r)-hermitian space of sign e. A subspace 
H C V is called totally isotropic if q\HxH = 0. Define \J{V,q) := StabGL^ (y )(<?)• 

Only two cases are encountered in this article: E = F, t = id or E/F is a quadratic 
extension, Gai{E/F) = {1,t}. In the first case, we get -F-quadratic (resp. symplectic) spaces 
when e = 1 (resp. e = —1); in the latter case, we will omit r and speak of £'/F-hermitian 



spaces, i?/F-sesquilinear forms, etc. The main concern, however, will be the case of quadratic 
spaces. 

Quadratic spaces As above, an i^'-quadratic space is a pair {V,q). We set q{v) := q{v\v). 
These two points of view on q, namely as a bilinear function on F x y or a quadratic function 
on V, will be used interchangeably. 

An element in a G F^ is said to be represented by ^ if a = q{v\v) for some v G V. When 
there is no worry of confusions, we will drop V and simply talk about the quadratic form q. 
The determinant of q is det q := det{q{ei\ej)ij) £ F^ /F^'^ where {ei, . . . , en} is a basis of V; 

n(n — 1) 

the discriminant of q is d±{q) := (—1) 2 det q. Note that d± factors through the Witt group 
of F. 

Up to isomorphism, there is a unique isotropic quadratic space (ie. 3v / 0, q{v) = 0) of 
dimension 2; denote it by M. 

The orthogonal group (resp. special orthogonal group) is denoted by 0{V, q) (resp. SO(y, q)). 

For oi, . . . , a^ S F^ , write (ai, . . . , a„) for the quadratic form on F" given by {xi, . . . , Xn) ^ 
aix\ + • • • anX^. For c S F^ , write cq for the scaled quadratic form {v,v') 1— )• cq{v\v'). These 
notions can be generalized to the case where F is replaced by an etale -F-algebra. 

We will make use of the Weil index 7^^ defined in [391 §14]. Let {V,q) be an F-quadratic 
space. The constant 7^^ is characterized by the identity 



{x -y)ipF{q{v))dxdy = j^p{q) / <p{x)dx 
VxV V 

for all Schwartz-Bruhat function (p on V, where we use the selfdual measure on V with respect 
to the bi-character ipp o 2q{-\-) : V x V — )■ C^. The map 7^^ induces a character of the Witt 
group of F; it only depends on the character of second degree ^pF o q : V ^ C^ . 

The Hasse invariant s{q) E {±1} of an F-quadratic form (V, q) is defined as follows. Choose 
a diagonalization {V, g) ~ (ai, . . . , am) and set 

s{q) ■■= n ((^i^"'j)F 

l<i<j<m 

where (•, ■)f is the quadratic Hilbert symbol of F. 

3 Twisted harmonic analysis 

3.1 General notions 

We will systematically use the notion of twisted spaces introduced by Labesse [18]. In this 
section, we collect some basic notions that will be needed later. Our main references are |20j 
and p6l, §1]. 

Twisted spaces A twisted space is a pair {G, G), where G is an F-group and G is a G-bitorsor, 

that is, 

• G acts on G on the left and right, written multiplicatively as (x, 6) 1— >• x6 and {6, x) 1— >■ 6x, 
respectively, where x G G and 5 £ G; 

• the two actions commute: {x5)y = x{6y) for all x,y G G, 6 G G; 

• G is a G-torsor under the action on either side. 

6 



One may also talk about the twisted subspaces {H,H) C {G,G), where H is a subgroup of G 
and H G G forms a i^-bitorsor. 

There is an obvious notion of isomorphisms between twisted spaces. A twisted space (G, G) 
is called untwisted if it is isomorphic to G = G on which G acts by left and right multiplications. 
The group G will often be omitted from the notations. As the definitions are purely categorical, 
one can also introduce twisted spaces in the category of locally compact spaces and define the 
functor (G,G) ^ {G{F),G{F)). 

Let S & G. Since G is a bitorsor, there is an unique automorphism Ad s '■ G ^ G such that 

5x = Adis{x)5, X £ G. 

One verifies that Ad xSy = Ad^jAd^Ad^ for all x,y £ G. The image of Ad 5 in the outer 
automorphism group of G is thus independent of 6; denote it by 9 := 9^. The action of 9 on 
Zg is well-defined. Thus we can set 

Z^ := Z^ = {x £ G : x5 = 6x for all 6 G G}. 

Using the automorphisms Ad « , define the centralizer and normalizer in G of a subset A <Z G 
as 

Z^{A) := {S £ G : Ad s{a) = a, for all a G A}, 
N^{A) ■.= {5£G: AdsiA) = A}. 

As in the untwisted case, there is the adjoint action of G on G via 5 1— t- x5x~^. Its orbits 
are called the conjugacy classes in G. Set 

G^ := StahciS), 
Gs := StabG((5)°. 

Measures Assume G{F) 7^ 0. The bitorsor structure permits us to equip G{F) with invariant 
measures. More precisely, let us fix 5o G G{F). Given a left (resp. right) Haar measure fi on 
G{F), we can transport it to G{F) via the homeomorphism G{F) — t- G{F), x i— t- xSq, thus 
obtain a left (resp. right) G(F)-invariant Radon measure fi ■ 6q on G{F). Similarly, by using 
the homeomorphism x 1— )■ 5qx, we obtain left (resp. right) measures 5o ■ fi. In particular, G{F) 
admits a bi-invariant measure if G{F) is unimodular. 

Let /U be a left or right Haar measure on G{F). We have 5o ■ ^ = AciAd Sq)iJ' ■ Sq, where 
AGiAdsfi) G ]R>o is the modulus of the automorphism Ad 5,,, defined by 

fiifoAdso) = AG{Ads,)fi{f), f G Gr(G(F)). 

When G{F) is unimodular and AciAdsf)) = 1 for all do, one can readily verify that fj,- 60 = 
5o • fi only depends on fi. This will be the case when (1) G is reductive and 9 is of finite order, 
or (2) when G is a torus. 

Moreover, since G{F) is homeomorphic to G{F), the usual notion of G^-functions and 
distributions carries over to G{F). 

3.2 Some structure theory 

Assume henceforth that G is a connected reductive F-group and G(F) / 0, and that the outer 
automorphism class 9 is of finite order. 



Parabolic and Levi subspaces A parabolic subspace of {G, G) is a pair {P, P) such that 
P is a parabohc subgroup of G, P := N^{P) and we require P{F) / 0. Since Ng{P) = P, 
we see that (P, P) forms a twisted space and P is uniquely determined by P. A twisted Levi 
component of P is a pair (M, M) where M is a Levi component of P and (M, M) is a twisted 
subspace of {P,P); the second condition is equivalent to M := Pn N^{M). In this case, it can 
be shown that M{F) ^ 0; see [351 1-6]- Write P = MU for the Levi decomposition where U is 
the unipotent radical of P, then P = MU accordingly. 

A Levi subspace (M, M) of (G, G) is a Levi component of some parabolic subspace. Let Aj^ 
denote the maximal split torus in Zj^-j. By [36l §1.2], we have M = Zg{Aj^), M = Zq{Aj^), 
and all Levi subspaces of G arise from split tori in this way. 

Maximal tori A maximal torus of (G, G) is a pair (T, T) such that 

• r is a maximal torus in G, T C G; 

• there exists a Borel pair {B,T) oiG xp F such that f = N^{T) n N^{B) over P; 

• r(p) / 0. 

Therefore (T, T) is a twisted subspace. Recall that we have a well-defined automorphism = Oj, 
on T since T is commutative. Define T as the subtorus of 0-fixed points and Tq := (T )°. We 
can also define the split torus Aj, as above. Then {T,T) is called P-elliptic if Aj, = A^. In the 
language of [201 §2.12], T is called a maximal torus and Tg is called a Cartan subgroup. 

Regular semisimple elements The quasi-semisimple elements of G are defined as those 
6 £ G such that Ad^ fixes a Borel pair of G Xp F. For such 6, it is known that Gg is reductive 
[321 9.4]. For a quasi-semisimple 6 £ G, define its Weyl discriminant as 

(1) D^{5) :=det{l- Ad s\q/q5). 

Definition 3.2.1. An element 5 £ G is called regular semisimple if 6 is quasi-semisimple and 
Gs is torus (cf. [20l (2.10.4) and §2.11]). A regular semisimple element 6 £ G is called strongly 
regular if G is abelian. 

A fundamental fact is that the regular semisimple elements form a Zariski open dense subset 
of G (see [201 §2.11]), which is certainly invariant by the adjoint action. One should bear in 
mind that G could be non-connected even for 6 in general position. 

In this article, we will only use strongly regular elements. Set 

Greg '■= {6 £ G : semisimple strongly regular}. 

The following construction can be found in [20| §2.12 and §2.19]. For any regular semisimple 
6 £ G{F), let T := Zg{Gs), T := T5. Then {T,T) is a maximal torus. Conversely, every 
maximal torus arises in this way. Note that G = T^, Gs = Tq. A regular semisimple element 
6 £ G{F) is called elliptic if its associated maximal torus T is. 

3.3 Representations 

Twisted representations Let (G, G) be a twisted space. A representation of G{F) is a 
triplet (7r,7f,y), often abbreviated as vf, where 



TT : G{F) — )• Autc(y) is a representation of G{F); 



• vf : G{F) — )• Autc(^) is a map such that 

7r{x6y) = 7r(x)7f((5)7r(y) 

for all x,ye G{F) and 6 G G{F). 

Two representations (vri, vfi, Vi), (vr2, 7f2, V2) are called equivalent if there exist (p : Vi ^ V2 and 
A G Autc(Vi) such that vri = (/9~-'^7r29J and tti = A(/9~-^7r2(/J. We call (tt, vf, 1/) irreducible if there 
is no subspace V ^V,V'^ {0} which is invariant by all n{d). This is in general weaker than 
the irreducibility of vr. If vr is irreducible, we will call vf strongly irreducible. We say that vf is 
smooth (resp. admissible) if vr is. In what follows, all representations of G{F) are assumed to 
be smooth. 

To a representation (vr,vf,y) we can associate its contragredient (vr"^ , vf "^ , F ^ ) as follows. 
Certainly, (7r^,F^) is the usual contragredient of (vr, 1^). For 6 G G{F), define vf^((5) by 
{n'^{d)v,v) = {v,it{6)-^v) for all i) GV^^veV. 

Characters Fix a Haar measure on G{F). By choosing 5q € G{F), we obtain a bi-invariant 
measure on G{F) using the bitorsor structure. Let vf be an admissible representation of G{F). 
For each / E C^{G{F)), set 



aG 



e^(/):=tr 



\g{f) 



This is well-defined by the admissibility of vf. This defines an invariant distribution on G{F). 
The following result is due to Clozel. 

Theorem 3.3.1 ([4, Theorem 1]). // vf is an irreducible admissible representation of G{F), 
then the distribution Q^ is a locally integrable function on G{F), which is locally constant on 
Greg{F). Moreover, iD'^liQ? is locally bounded on G{F). 

Let vf be as above, we define the normalized character of vf as the locally bounded function 
on G{F) 

/^(vf,.):=|i)^(-)l^ef(.). 

Note that as locally integrable functions, G^ and I {tt, •) are independent of the choice of 
measure on G{F) 

Matrix coefficients Let (vf,vr,y) be a representation of G{F). For v C^ v £ V"^ (8" V, define 
the corresponding matrix coefficient as the smooth function on G{F) 

fmv ■ 5^ {v,Tr{6)v). 

This defines a linear map V"^ ^V^- C{G{F)). Let ^(vf) be its image. 

Assume henceforth vf admissible and strongly irreducible, i.e. vr is irreducible. We know that 
V^ (g) "V^ — )• ^(vf). By forgetting the twist, we also have the space of usual matrix coefficients 
V^ (g) y — ;• ^(vr). Hence there is an isomorphism f >-^ f° from ^(vf) to ^(vr) which satisfies 

{fmvra) = {v,v)- 

For / G ^(vf), one can check that /(z-^z) = f{S) for all z G Zg{F), 6 G G{F). To state 

the next result, we also have to fix a Haar measure on Zg{F). This permits to define the formal 
degree c?(vr) when vr is essentially square-integrable modulo Zg{F). 



Proposition 3.3.2. Asswne vr to be supercuspidal and irreducible. Let f G A{Tf). Let S G 
Greg{F)- If ^ is elliptic in G, then 



r(l)Gf (5) = d(^) j f{x-Hx)dx. 



Zg{F)\G(F) 

Proof. This is essentially a consequence of [20^ (4.1.3)], in which the expression /(x~^(5a;) is 
replaced by 

vol(K)-^ f f{x-^k-^5kx)dk 
K 
where K is any open compact subgroup of G{F). Our assumption on 5 implies the com- 
pactness of Zg{F)\Zg{F)Gs{F) = Z^{F)\Gs{F). Since x i— )• f{x~^6x) is integrable over 
Zg{F)Gs{F)\G{F), it is also integrable over Zg{F)\G{F). Hence the integral over K can be 
absorbed into the outer one, as required. D 

Remark 3.3.3. It would be desirable to extend the result to tt square-integrable modulo Zg(F), 
cf. O Proposition 5]. This requires more knowledge about the Schwartz-Harish-Chandra space 
in twisted setting. 

3.4 Orbital integrals 

Ordinary orbital integrals Let 6 G Greg{F). It is known that the orbit {x6x~^ : x G G{F)} 
is closed in G{F) and G^{F), Gs{F) are unimodular (see [20l §5.1]). Choose a Haar measure on 
Gs{F). The unnormalized orbital integral can thus be defined as the distribution 

(2) of if) := [G\F) : Gs{F)]-' J fix'Hx) dx, / G GT{G{F)) 

Gs(F)\G{F) 

where Gs{F)\G{F) is equipped with the quotient measure. The normalized orbital integral is 
defined by 

I^{6,f):=\D^{S)C^0fif). 

The following result is well-known. For the lack of an appropriate reference, we give a quick 
proof below. 

Proposition 3.4.1. Let f G G^{G{F)). Fix a maximal torus T of G and fix a Haar measure 
on Tq{F), which permits to define I^{6, f) for 6 G Greg H T{F). Then 5 i— )• I^{5, f) is a locally 
hounded function on Greg H T{F) . 

Proof. By twisted descent for Of{f) [SI 2.4] and \D^{6)\^ (use [IZl 1.1 and 1.3]), it suffices to 
prove a similar untwisted assertion on Lie algebras. Now apply [lit Theorem 13]. D 

Now we can state the twisted Weyl integration formula. Let (T, T) be a maximal torus and 
set 

T{F)/e := (1 - e)T{F)\T{F), 
f(F)/0:={l-e)T{F)\f{F). 

Then {T{F) iq,T{F) jq) is a twisted space. We can also regard T{F)iq as the space of 

r(i^)-conjugacy classes in T{F), therefore D^{-) factors through T{F)iq. The projection map 
Tg{F) — )• T{F)/0 is locally a homeomorphism. Two measures on Tg{F), T{F)/g are called 
compatible if Tq{F) — )• T{F) jq preserves these measures locally. 
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Proposition 3.4.2 ([36[ §1.4] or [20\ (5.3.6)]). Let f be an integrable continuous function on 
Greg{F). Then 

I f{6)d6= Y. K'lKr' 

aeg{F) Me£<5(Mo) 

J2\W{M{F),f{F))\-' J \D^{t)\0f{f)dt 

where 

• Mq is a chosen minimal Levi subgroup of G; 

• £.^{Mo) is the set of Levi subspaces {M,M) with M D Mo; 

• ^0 ^* ^^^ Weyl group of M with respect to Mq, and similarly for Wq; 

• {T,T) runs through the M{F)-conjugacy classes of elliptic maximal tori of (M,M); 
. W{M{F),f{F)) :=NMiF){f{F))/T{F); 

• the m,easure on T{F)iq is induced from that on T[F) iq, which is compatible with the Haar 
measure on Tg {F) . 

Here the orbital integral Of{f) is defined as in ([2]), using the chosen measure on Tq{F). 

Stable orbital integrals By definition, call 81,82 G Greg{F) stably conjugate if they are 
conjugate by G{F). Call two maximal tori (TijTi), (r2,T2) of {G,G) stably conjugate if there 
exists X E G{F) such that Ad^^ induces an F- isomorphism {Ti,Ti) — )• (T2,T2). 

Choose Haar measures on Tg{F), for every maximal tori (T,T), so that for stably conjugate 
Ti, T2, the measures on Tifi{F) and T2fi{F) match. Define stable orbital integrals as follows: 
for each 8 G Greg{F), set 

(3) SOf{f):=Y,0§{f), feC^iGiF)) 

S' 

where 8' ranges over the conjugacy classes in the stable conjugacy class of 8 and Of,{f) is defined 
using the measure prescribed above. The normalized stable orbital integral is defined by 

5^(<5,/):=lZ?^(5)1^50f(/). 

As before, for each maximal torus {T,T), we define F- varieties 

T/g := (1 - e)T\T, 
f,e := (1 - e)T\f. 

Then {Tiq^Tiq) is a twisted space. We can regard Tfg{F) as the space of stable conjugacy classes 
in T{F) under T-action. The projection map T (F) — )• Tig{F) is locally a homeomorphism. Two 
measures on Tg{F), T/g{F) are called compatible if Tg{F) — ;■ T/g{F) preserves these measures 
locally. 
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Proposition 3.4.3. Let f be an integrahle continuous function on G^egiF). Then 



I f{6)d6= ^ K^|Kri^|T^(M,f)(F)|- 

aog{F) MG£<5(Mo) T 



|Z?^(t)|50f(/)dt 

where 

• {T,T) runs through the M{F)-stable conjugacy classes of elliptic maximal tori of {M,M); 

• W{M,T) := Nm{T)/T as an F-group, and W{M,T){F) is the group of its F-points; 

• the measure on T/g{F) is induced from that on T/q{F), which is compatible with the Haar 
measure on Tg(F). 

Proof. This can be proved either by modifying the proof of Proposition 13.4.21 in the stable 
setting, or by collecting the terms in Proposition 13.4.2] according to stable conjugacy. D 

Note that Tg{F) -^ T/g{F) is equal to the composition Tg{F) -^ T{F)/g -^ T/g{F); all 
arrows in sight are local homeomorphisms. 

Remark 3.4.4. When (G, G) is untwisted, we will remove the ~ in the notations and write 
0^{f), ©^(/), etc. (where / G C^{G{F))) in the untwisted setting, without further explana- 
tions. This conforms to Arthur's notations in [3]. 

In the untwisted setting, strongly regular semisimple elements form a Zariski open dense 
subset. 

3.5 Relation to non-connected groups 

The language of non-connected reductive groups is used in other literature such as [1] . Recall 
that an F-group G+ is called reductive if {G~^)° is, for example the orthogonal group 0{V,q) 
of an F-quadratic space {V, q). This notion is related to twisted spaces as follows. 

Let (G, G) be a twisted space and be the associated outer automorphism. Assume 6 to 
be of finite order. Choose any 5 £ G, then there exist an integer n and x G G^DiF) such that 
(Ad 5)" = Ada;, where Gad denotes the adjoint group of G. Upon increasing n, we may even 
assume x G G{F). Let Adf be the free abelian group generated by the symbol Ad 5. It acts on 
G in the obvious manner. Define the quotient group 

G^ := (G X Ad^ I / the normal subgroup generated by (x^^ xi Ad^). 



Then G"*" is a non-connected reductive group, and G can be identified as a G-bitorsor with 
G XI Ad^ C G^ via x5 1— )■ x x Ad 5. Conversely, for any non-connected reductive group G~^ and 
a connected component G of G~^, we get a twisted space (G := (G+)°, G). 

By fixing the base point 6 € G and writing 9 := Ad 5, we may also reduce to the {G,8)- 
twisted situation in [17] . Indeed, the homeomorphism x6 >-^ x between G{F) and G{F) permits 
to identify G^{G{F)) and C^{G{F)). Under the identification, we have 

0£(/) = [G^\F) : G^siF)]-' J fig-'xOig)) dg. 

G^s{F)\G{F) 
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A representation {7r,ft,V) becomes a representation {tt,V) of G{F) equipped with an in- 
tertwining operator A : V ^ V such that tt o = AitA~^. Indeed, up to equivalence we have 
A = n{5). Its twisted character becomes the distribution / i— )• tr (7r(/) o A) on G{F). 

Conversely, given a connected reductive F- group G and 9 G Aut(G), we can form the space 
G which is isomorphic to G as F-varieties, whose elements are written formally as gO, g £ G, 
with the G-bitorsor structure given by x{g9)y = xg9{y)9 for all x,y,g £ G. Then {G,G) is a 
twisted space whose outer automorphism class is exactly that of 9. 

3.6 Example: GLe{N) 

Let E/F be a field extension with [E : F] < 2. Set r to be the nontrivial element in Gal(-E/-F) 
if [E : F] = 2, otherwise r := id. Let H he a finite-dimensional ii^-vector space. Define 

GLe{H) := {q : H X H ^ E : non-degenerate {E,t) — sesquilinear form}. 

This is an F- variety. Regard GLe{H) as an F-group by restriction of scalars. There is a 
natural GL£;(ff)-bitorsor structure on GLe{H), namely for q S GLe{H), 

(4) xqy: {v,v')^ q{x~''^v\yv), x,y £ GLEiH). 

Recall that GhE{H) can also be identified with IsouiEiFfyH"^): to y G lsoinE{H,H'^) we 
associate qy '■ iv,v') i— )■ {Yv,v'). The bitorsor structure can be easily described: 

(5) yYx'^^xqyy, x,y £ GLe{H). 

One readily checks that {GhE{H),GhE{H)) forms a twisted space. In particular, the con- 
jugacy class of q is the space of {E, T)-sesquilinear forms on H which are equivalent to q. To 
simplify notations, we use the same symbol GLe{H) to denote the set of its F-points. 

If moreover a basis ei, . . . ,e]y of H over E is chosen, the twisted space will also be denoted by 
(GL^(A^),GL£;(A^)). The outer automorphism class associated to (GL(A'"), GL(A^)) is nothing 
but that of X I—)- *x~^, where *x is the hermitian transpose x. 

When E = F, we write simply (GL(i^), GL{H)); this is the twisted space of non-degenerate 
bilinear forms on H. Once a basis is chosen, we will denote it by (GL(A^), GL(A^)) as before. 

For the reader's comfort, we record the following result. 

Lemma 3.6.1. In GLe{H), every regular semisimple element is strongly regular. In particular, 
strongly regular semisimple elements form a Zariski dense open subset in GhE{II). 

Proof. This follows from the explicit description of centralizers of semisimple elements: when 
E = F, this can be found in [Ml 1-3]; when [E : F] = 2, see % W.II.B.2]. D 

4 Twisted endoscopy for GL(2n) 

4.1 GL{2n) and its elliptic endoscopic data 

The twisted GL(2n) Our setting is the case 'V = 1" in [37], which conforms to Arthur's 
setting in [3; §1.2]. 

In this section, we consider an F-vector space H of dimension N = 2n. Fix a basis 

Cl) • • • ) Cn; C_j2, . . . , C— 1 
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for H. We will study the twisted space of non-degenerate bilinear forms on H defined in 
denoted by (GL(2n), GL(2n))._^ 

We fix the base point 6 G GL(2n) defined by 



0iei\ej] 



(-l)*(5i,_j, l<i<n, Vj, 
(- 1)^+1 5,,_,-, -n<i<-l,yj, 



where di-j is Kronecker's delta. This defines a symplectic form on F^". Let := Ad^. Unwind- 
ing definitions, we see that 6 is the adjoint-inverse involution with respect to 9, characterized 
by 9{9{x)~^v\v') = 9{v\xv') for ah x G GL(2n) and all v,v'. Moreover, GL(2n)^ = GL(2n)g is 
the symplectic group associated to 9. We will denote the Lie algebra of GL(2n)g by g[(2n)g. 
Set 

B := StabGL(2n)[0 C (ei) C ••• (ei, . . . , en, e_n) C ••• C (ei, . . . ,e_i)], 
T := the diagonal subgroup of GL(2n). 

Then {B,T) is a 0-stable Borel pair, thus {B,B9) is a twisted Borel subgroup and (T,T9) is a 
twisted maximal torus. This can be seen, for example, by representing 9 by an anti-diagonal 
matrix. Their 0-fixed points {B^,T^) form a Borel pair for GL(2n)g. These choices permit to 
define transfer factors unambiguously. We will return to this point in 



Endoscopic data In this article, we only consider elliptic endoscopic data. The following 
definition is from [3, p. 12]; see also [371 §1-8]. 

Definition 4.1.1. An elliptic endoscopic datum for GL(2?7-) is a triplet {no,ns,x)j where 

• noiTLs G Z>o are even; 

• no + ns = n; 

• X '■ Tf — ^ {=tl} is a continuous character satisfying x = 1 if no = 0, and x 7^ 1 if ^O = 2. 

To {no-,ns.,x) we associate the endoscopic group G := SO(y, q) x S0(n5 + 1), where S0(ns' + 1) 
is the split odd special orthogonal group associated to some F-quadratic space of dimension 
ns + 1, and {V,q) is an F-quadratic space such that 

• dim V = no; 



• K = F[-^J d±{q)\ is the extension associated to x by local class field theory (recall that 
d±{q) = ( — 1)'^'^'^ det g is the discriminant of q); 

• SO(y, g) is quasisplit; 

Note that SO(y, q) ^ Gm by our conditions. Equivalently, (F, q) is not isotropic of dimension 
two. 

Remark 4.1.2. The possible choices of iy,q) can be described as follows. Write K = -F[-v/^] 
for the field extension associated to x-, for some c) G F^ /F^'^. We may assume no > 0, then 

{V, q) ~ {no - 2)]H c(l, -d) ~ c{{no - 2)EI (1, -t))), 

where c G F^/F^'^ is arbitrary. If [K : F] = 2, (1, — 5) is the quadratic form x i— )• Nj^ip^x) 
on E] otherwise c(l, — t)) ~ H. Moreover, K/F is determined by the minimal Levi subgroup of 
SO(y, (7), which is a torus isomorphic to (Gm)"'^~^ x KerA'^/^/^ if [K : F\ = 2, otherwise split. 
In short, we have built up bijections 

(6) {no.ns, x) < — > {no,ns, K/F) i — > {no, ns, SO(y, q) : quasisplit). 

14 



Let {no,ns,x) ^iid G = SO{V,q) x SO{ns + 1) as above. The general theory of twisted 
endoscopy furnishes a finite group Out2n(G) defined in terms of automorphisms of {no,ns,x) 
[171 P-18]. In our case, it is simply 

Out2n(G) = 0{V,q)/SO{V,q) = Out(G), 

where Out(-) denotes the outer automorphism group. It is nontrivial if and only if no > 0, in 
which case Out2n(G') ~ Z/2Z is generated by any reflection of the quadratic space (V, q). Hence 
we can regard Out2n(G) as a group of F-automorphisms of G modulo inner automorphisms 
coming from G{F). Its actions on conjugacy classes and representations are thus well-defined. 
An elliptic endoscopic datum {no-,ns-,x) is called simple if no = or ng = 0. Define the 
finite sets 

<Scii(2n) := {elliptic endoscopic data of GL(2n)}, 
(?sim(2ra) := {simple endoscopic data of GL(2n)}. 

The general formalism of twisted endoscopy is quite involved: see [T7]. Two simplifications 
occur in our case. Firstly, we do not need to pass to z-extensions of G even though the derived 
group of G is not simply connected. This is due to the existence of natural L-embeddings 
^G ^-J- ^Glj{2n) for every elliptic endoscopic group G; see [371 1-8]. Secondly, there is no need 
to twist the endoscopic group as in [IB]. 

For the geometric aspect, we only make use of the following concepts: 

1. correspondence between "very regular" semisimple classes 

2. Whittaker normalization of geometric transfer factors 



3. explicit formula of transfer factor of the case G = SO(y, g), defined relative to various 
choices (-F-splittings, etc. ) - ^6.31 

4. transfer of orbital integrals - ^4.51 

Details will be given in the case n^ = 0, G = SO(y, g). The spectral counterparts will be 
deferred to ^ 

4.2 Correspondence of very regular classes 

We will use the parametrization in [371 §1-3, §1.4], paraphrased in terms of etale F-algebras as 
in [211 §3] • In each case under consideration, we are going to define a Zariski dense open subset 
of the subset of regular semisimple elements, called the set of very regular elements. 

Besides the groups which intervene in the twisted endoscopy for GL(2n), we also treat 
symplectic, unitary groups and GIj e{N)^ which will be useful in ^ 

It should be emphasized that for SO(y, q) with even dim V ^ we will only describe the 0{V^ q)- 
conjugacy classes therein. 

Conjugacy classes in GL(2n) The strongly regular semisimple conjugacy classes in GL(2n) 
are parametrized by triplets {L,L±,x), where 

• L is an etale F-algebra of dimension 2n; 

• L± is the fixed subalgebra by an involution r G Ant f{L); 

• X £ L^ generates L over F. 
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Note that r is determined by L±, thus is omitted in the notation. This can be seen by decom- 
posing L± into fields: L± = Y\i^jL±i. Decompose L = Hie/ -^« accordingly, where Li is an 
etale L±^j-algebra of dimension 2. Hence we are reduced to the case L± is a field: if L = L± x L± 
then T{x,y) = {y,x), otherwise r is the nontrivial element in Gal(-L/L-|-). This trick furnishes 
a dictionary between the terminology in [37j and ours. 

To a triplet {L,L±,x), we choose an isomorphism of F- vector spaces L ~ F^" and set the 
associated x £ GL(2n) to be 

x{v\v') = tr i/p{t{v)v'x), v,v' £ L. 

The conjugacy class of x is independent of the choice of isomorphism L — )• F"^^. The pair of 
etale F-algebras (L, L±) are determined by x, up to isomorphism. The datum x £ L^ , however, 
is determined only as an element in L±^ /Ni^n^[L'^). 

A strongly regular semisimple element of GL(2n) is called very regular if its parameter 
{L,L±,x) satisfies 

-^±l£L\ 

Remark 4.2.1. Let 6 S GL(2n) be parametrized by {L,L±,x), regarded as a non-degenerate 
bilinear form on F. The following observation will be useful: if *(5 is the transposed form 
{v,v') I—)- 6{v'\v), then 6 + ^5 is a quadratic form parametrized by {L,L±,x + t{x)), provided 
that xt{x)~^ — Is L^ . This assertion also holds in the sesquilinear context, which will be 
discussed later. 

Conjugacy classes in GL(2n -|- 1) The strongly regular semisimple conjugacy classes in 
GL(2n -|- 1) are parametrized by quadruplets (L, L±,x, xd), where (L, L±,x) is the same as the 
case of GL(2n), and xd G F^ /F^'^. The corresponding bilinear form x is given by Qx ® {xd), 
where qx is the bilinear form constructed from {L,L±,x) as before. The notion of very regular 
elements is unaltered; it does not depend on the extra parameter xd- 

Conjugacy classes in odd orthogonal groups Let {V, q) be an F-quadratic space of di- 
mension 2n -|- 1. For a semisimple element in SO(y, g), "very regular" means regular without 
eigenvalue —1 if regarded as an endomorphism of V . Conjugacy classes of such elements are 
parametrized by quadruplets {L,L-i-,y,c) where 

• {L,L±) and r G Autir(L) are as above, diuip L = 2n; 

• y £ L^ generates L over F, and yT{y) = 1; 

• c £ L± ^ , to which we associate the F-quadratic form on L defined by 

qc{v\v') =tvL/F{T{v)v'c), 
and we require that (L, Qc) ® (a) ~ {V, q) for some a £ F^ . 

By Witt's cancellation theorem, a is uniquely determined by {L,L±,c) up to F^^. We look 
upon SO(L, Qc) as a subgroup of SO(y, q). To the datum (L, L±,y, c), we associate the element 
in SO{V,q) corresponding to y G SO{L,qc). As before, the triplet {L,L±,y) is uniquely deter- 
mined, while c is unique only in L±^ /Niii^{L^). This construction does not depend on the 
isomorphism {L,qc) ® (a) — )• {V,q). 
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Conjugacy classes in even orthogonal groups Let {V, q) be an F-quadratic space of 
dimension 2n. For semisimple elements in SO{V,q), "very regular" means regular without 
eigenvalue ±1. Conjugacy classes by 0(y,q) of such elements are parametrized by quadruplets 
(L, L-i-,y, c) such that 

• (L, L±,y, c) satisfies the conditions in the odd orthogonal case, to which we associate the 
quadratic space (L, qc) by the same recipe; 

• we require that {L,qc) ~ (^, <?)• 

Everything works in the same manner as for odd orthogonal groups, except that (1) there is 
no (a) and SO(L, qc) can be identified with SO(F, q); (2) what we get are just the very regular 
0{V, g)-conjugacy classes. This suffices for our purpose. It can be shown that each very regular 
0(F, g')-conjugacy class splits into two SO(F, g)-conjugacy classes. 

Conjugacy classes in symplectic groups The symplectic case is the easiest. Let (W, q) 
be a symplectic space of dimension 2n, whose symplectic group is denoted by Sp(VF, q). In this 
case, very regular means regular semisimple. Conjugacy classes in Sp(VF, q) are parametrized 
by quadruplets (L, L±, y, c) such that 

• {L,L±,y) is as in the odd orthogonal case; 

• dim^r L = 2n; 

• c £ L^ satisfies t{c) = — c. 

To this datum we define a symplectic form on L as qc ■ iv,v') i— )■ tr j^/p(r(f)f'c). By choosing 
an isomorphism of symplectic spaces {W,q) —> {L,qc), we obtain the element in Sp{W,q) cor- 
responding to y, whose conjugacy class is independent of the chosen isomorphism. The triplet 
{L,L±,y) is determined up to isomorphism, while c is determined only up to multiplication by 
elements oi Ni^ji^{L^). 

Conjugacy classes in unitary groups Let E/F be a quadratic extension, r be the non- 
trivial element in Gsl{E/F). Let iV^h) be a £^/F-hermitian space. Very regular elements of 
U(y, /i) are the regular semisimple elements without eigenvalue ±1. They are parametrized by 
triplets {L-i-,y,c) such that 

• L± is an etale F-algebra; 

• Set L := L-t 0f E, which is an etale -E-algebra, then r induces an involution in AutL_^(L) 
which we denote by the same letter r; 

• y € L^ generates L over F, and yT{y) = 1; 

• c ^ L±; 

• the £^/F-hermitian form on L defined by qc : {v,v') i— )■ ti ];^/e{t{v)v'c) is isomorphic to 
{V,h). 

To {L±,y,c) we associate the element corresponding to y G \J{L,qc), whose conjugacy class is 
well-defined. The datum c is unique in L±^ /Ni^n^{L^). 
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Conjugacy classes in GLe{N) Let (E/F,t) be as above. The strongly regular elements 
in GL£;(A^) are parametrized by data {L,L±,x), where {L,L±) is as in the case of unitary 
groups, dim^; L = A^, and x G L^ is such that F{x) = L. The corresponding sesquilinear form 
is isomorphic to the form {v,v') i— )• tr^/^(r(7;)z;'x) on L. The datum x is determined up to 
multiplication by N^n^ (^ ^ ) • The notion of very regular elements is defined as in the case for 
GL(2n). 

Transposed forms *(5 and the associated hermitian forms ^5 + 5 are parametrized in the same 
manner as in the case of GL(2?7-). 

Centralizer and stable conjugacy Consider an element 5 G G{F), where G is equal to one 
of the classical groups mentioned above; or alternatively 6 G G{F), where G is the a twisted 
space considered in ^3.61 

Proposition 4.2.2. // 6 is very regular, then G = Gs except for G = GL(2n + 1), in which 
caseG^ = Gs-{±l}. 

Proof. The assertion is well-known in the untwisted case, see eg. |21l §3]. As for the twisted 
case, this follows from the description of centralizers in |331 p. 194] and [6l W.II.B.2]. Actually, a 
slightly different parametrization is used therein. Let L± = HiG/ -^±.« ^^ ^^^ decomposition into 
fields, and decompose L = Yli^j Li accordingly;, write x = {xi)i^j. The parameters in jl33l [6] 
correspond to {xiT{xi)~^)i^j. Except in the case GL(2n + 1), the possible disconnectedness of 
G is caused by those i with xjt(xj)~^ = ±1, which is ruled out by our assumption. D 

Proposition 4.2.3. Let 6 be very regular with parameter (L, L±, . . .), then 

Gs ~ L^ := {ae L"" : aT{a) = 1}, 
viewed as an F-group. 
Proof. This follows from the explicit description of Gs in [331 ED E], ^^ alluded above. D 

Assume now G is a quasisplit F-group. Two semisimple elements 5,j^ G{F) are called 
stably conjugate if they are conjugate by G{F). 

Recall that stable conjugacy is also defined for elements in Greg{F) in ^3.41 To get the 
parametrization of strongly regular semisimple classes in G{F), where G is one of the twisted 
spaces in ^3.6\ we replace the x £ L^ /Ni/i^{L^) in a parameter {L,L±,x) by its image in 
L-/LI. 

To get the parametrization of very regular stable conjugacy classes in classical groups (mod- 
ulo 0(y, (7)-conjugacy in the even orthogonal case), it suffices to forget the datum c in the 
parametrization above. We will simply write {L,L±,y), etc., for the parameters of stable 
classes. 

Definition 4.2.4 (Cf. ^ §1.9]). Let {no,ns,x) e SciiC^n) and G = SO{V,q) x S0(n5 + 1) be 
the associated endoscopic group. Let 5 G GL(2n, F) and 7 = (7', 7") G G{F) such that 7',7" 
are very regular elements. Suppose that 5 (resp. 7', 7") is parametrized by {L,L±,x) (resp. 
(L',L'_j_,y'), {L" , L'j_,y"). We say 6 corresponds to 7, written as 5 -H- 7, if 

1. there exists an isomorphism of pairs of F-algebras 93 : (L' x L" , L'_^ x L'i_) — )• (L, L±); 

2. letting y := ip{y',y"), we have 

x 

~T^ = -y- 

In this case, 5 is also very regular. 

Clearly, the correspondence only depends on stable conjugacy classes on both side. 
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4.3 A separation lemma 

In this subsection, we concentrate on simple endoscopic data of the form (2n,0, x)i with endo- 
scopic group G = SO(y, g) where dimT/ = 2n. By Remark 14.1.21 it suffices to investigate the 
quasisplit groups SOiV^q). 

Lemma 4.3.1. Let 6 £ GL(2n,F) be very regular semisimple. If (yi,qi), {V2,q2) o,re F- 
quadratic spaces of dimension 2n such that for each i = 1,2, 

• SOiVi^qi) is quasisplit; 

• there exists a very regular 'ji E SO{Vi,qi) such that 'ji -^ 5 via twisted endoscopy. 

Then there is an isomorphism (p : SO(Vi,gi) ~ SO(V2,q'2), and 99(71), 72 are stably conjugate 
up to 0(V2;^2)- In particular, the corresponding endoscopic data are equivalent. 

Proof. Take the parameter {L,L±,x) for 6. For i = 1,2, if 7^ o 6, then Definition 14.2.41 
implies that the stable conjugacy class of 7^ up to 0{Vi,qi) is parametrized by {L,L^,y) with 
y := —xt{x)^^. Hence it suffices to prove the first assertion. 

Choose {L,L±,y) as above. By assumption, for i = 1,2 there exists Cj G L^ such that 

{Vi,qi) ~ {L,{trL^/F)*{ciML/Lj) 

where CiMi/i^^ is the L-^-quadratic form given by 

{v,v') ^ trL/L±{T{v)v'ci) = atv l/l^{t{v)v'), v,v' G L; 

and {tr ij_/i)*{ciMi/i±) is its composition with ti ^^/f, which yields an F-quadratic form on 
L. 

We claim that detgi = detg2- Indeed, set t := C2C^ and write 

ciMl/l± = {a,h), a,bGL^; 

C2ML/L^ = {ta,tb). 

Then we have 

(Vi,gi) ~ (tr L±/F)*{a) e (tr L±/F)*{b), 
{V2, q2) ^ {tT L^/F)*{ta) (B {ti L±/F)*{tb). 

A straightforward calculation (cf. [25, p. 668]) shows that 

det((tri^/^),(ta)) = iV^^/^(t) det((tr i^/^),(a)) 

and similarly for det((tr ^^/^)=i,(i6)). Hence detg2 = -^l±/l(0^ det gi = detgi. 

It follows that SO{Vi,qi) and SO(V2,g2) are inner forms (in fact, pure inner forms) of each 
other. By the uniqueness of quasisplit inner forms, we conclude that SO{Vi,qi) ~ SO{V2,q2)- 

a 
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4.4 Geometric transfer factors of G = SO(y, (/) 

Splittings and transfer factors Recall that we have fixed a 0-stable Borel pair {B,T). Let 
A{B,T) denote the set of simple roots over F associated to {B,T). A splitting of GL(2n) 
adapted to {B,T) is a datum {B,T, {Ea)aeA(B,T))j where Ea G Ql{2n,F) lies in the root sub- 
space of a and Eq. 7^ 0. A splitting {B,T, {Ea)a) is called an F-splitting if it is rjT'-invariant. 
The involution 9 also acts on F-splittings adapted to {B,T) since {B,T) is ^-stable. 

Iterating the definition above to the Borel pair {B^T^) := {B n GL{2n)g,T n GL(2n)g) 
for GL(2n)g, we can also define the (i3^,T^ )-adapted F-splittings {B^ ,T^ , {E p) p^/^tge ^'j^0\) of 
GL(2n)g-. 

In fact, splittings can be defined for all quasisplit connected reductive groups. 

Proposition 4.4.1. The restriction map X*{T) — )• X*{T^) induces a Tp-equivariant bijection 
from the set of 9 -orbits of A{B,T) to A{B ,T ). Let {B,T,{Ea)a) be a 9-stable splitting of 
GL(2n). To each /3 G A{B^,T^) corresponding to a 9-orbit O in A{B,T), put 

Ep := 2_^ ^a- 

Then {B,T,{Ea)a) '-^ (-B^,r^, (i?^)^) is a Fp-equivariant bijection from the set of 9-stable 
{B,T)-adapted splittings to the set of splittings of {B ,T) -adapted splittings. 

Proof. The first part is contained in [17, §1.3]. For the second part, see \n\ p. 61]. D 

Let {no,ns,x) G £cn{2n) with endoscopic group G. Following the recipe in [31], one can 
define a transfer factor 

A : Grcg(F) X GLreg(F) ^ C 

such that 

• A(7, (5) / if and only if 7 o (5, 

• A (7, (5) depends only on the conjugacy class of 5 and the stable conjugacy class of 7, taken 
up to Out2n(G). 

The transfer factor also depends on the choice of an F-splitting {B^, T^ , {Ep)^), or equiva- 
lently a 6'-stable F-splitting {B,T, {Ea)a) by Proposition 14.4.11 

As we prefer to use normalized orbital integrals, our transfer factor does not contain the 
term A/y in [17] . 

Whittaker normalization Let {B, T, (-E'o)agA(s,T)) be a ^-stable F-splitting of GL(2n). Let 
U be the unipotent radical of B. Define the algebraic homomorphism 

using {Ea)a, as in [281 §3-1]. Recall the fixed additive character ipp and set A := ipp o Xq on 
i^-points. Then A : U{F) — )• C^ is a ^-stable generic character. Conversely, every 0-stable 
generic character of U{F) arises in this way. By a ^-stable Whittaker datum of GL(2n), we 
mean a pair [B, A) thus obtained. 

Definition 4.4.2 ([3, p. 55] and [13 §5.3]). Let {B, X) be a 6l-stable Whittaker datum of GL(2n) 
arising from the 6'-stable -F-splitting {B,T, {Ea)a£A{B,T))^ ^^ define the Whittaker-normalized 
transfer factor for an elliptic endoscopic datum {no,ns,x) G Sdli^n) by 

Ax:=e(^,X,i^F] A, 
where A is the transfer factor relative to {B,T, {Ea)aeA{B,T))- 
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It is shown in [TT, pp. 65-66] that Ax only depends on (i?,A). 

Remark 4.4.3. The e-factor can be expressed in terms of the Weil index, as follows. If x is 
trivial, set if = F x F as an F-algebra, otherwise K/F is the quadratic extension attached to 
X by local class field theory. We have 



e ( 2 ' X, V-F j =1^F {^k/f) 



where Nj^/p is the F-quadratic form v i— t- Nj^ip{v) on K. We have Nj^ip ~ H if and only if 
K = Fx F. 

In order to use Waldspurger's formula for A, we have to choose splittings, define and then 
calculate the constants rj^rnyq^ E F^ in [371 §1-6]. 

A regular nilpotent element in gl(2n, F)g Let (-B^, T^, (-£'/3)^gA(_B»,T'')) be an F-splitting 
ofGL(2n)g. Set 

N:= Y. ^P- 

I3£A{B»,T0) 

Then A^ is a regular nilpotent element in the symplectic Lie algebra gl{2n,F)g. Consider the 
symmetric bilinear form on F^": 

{v,v')^e{v\N^'''-\'). 

It is equivalent to (null form) © (r/) with r] £ F^ /F^'^. This is what we aim to calculate. 

The construction above only depends on the GL(2n, F)e-conjugacy class of N. By [T9l 
Lemma 5.1A] every GL(2n, -F)5i-conjugacy class of regular nilpotent elements in 0l(2n, F)q con- 
tains an element of the form A'^, for some choice of {Ei})^. Therefore we can forget the F- 
splittings and concentrate on regular nilpotent elements. 

Define an endomorphism N : i^^" — )• F^" by 



1 < i < n, 

—n < i < —1. 
One can check that N G Ql{2n,F)g. Moreover, N is regular nilpotent and 

ifi = -l, 



Nei 


= 0, 




Nei 


= Ci- 


-1 


Ne.n 


= en. 


) 


Nei 


= Cj- 


-1 



Ar2"-ie,- 



otherwise. 



Hence 9{e-i\N e_i) = 0(e_i|ei) = 1. Summing up: 

Lemma 4.4.4. Suppose the F-splitting {B ,T , {Ep)a^/s,i^B pe\) is chosen so that the associated 
regular nilpotent element is conjugate to the N defined above. Then ij = 1. 

Our choice of N is compatible with the 0-stable Whittaker datum {B{2n), A(2n)) of GL(n) 
chosen in p, p. 55]. 
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A regular nilpotent element in 5o{V,q) In this paragraph we consider an F-quadratic 
space {V,q) of dimension 2n with quasisplit SO{V,q). 

For n = 1, define ??(i/,g) £ F^ /F^"^ to be any class represented by q. 

Henceforth we assume n > 1. Let (B',T', {Ea)aeA{B',T')) be an F-splitting of SO(y,q). Set 

N:= Yl ^" 

agA(B',T') 

as usual, then A^ is a regular nilpotent element in 5o{V,q). Consider the symmetric bilinear 
form on V: 

{v,v')^q{v\N^''~'^v'). 

As in the previous case, it is equivalent to {ri{y^q)) for some ^(i/,g) G F^ / F^"^ modulo null forms. 
This defines 'r](v,q)- ^^ before, we forget F-splittings and just consider any regular nilpotent 
Ne50{V,q). 

To study il{v,q)^ the first step is to reduce to the split odd orthogonal case. Set m := n — 1 
and write 

(7) {V,q)c^mmeiV',q') 

where {V , q') is a 2-dimensional F-quadratic space, uniquely determined by Witt's cancellation 
theorem. In fact, {V',q') ~ H if SO(y,q) is split, otherwise it is the anisotropic kernel of {V,q)- 
Let y G F^ be any element represented by q'. There exists a unique y' G F^ /F^'^ such that 
{V',q') ~ {y,y'). We set {V\q^) :=mM®{y) so that 

{V,q)^{V\q')(B{y'), 

and SO{V ,q) is a split odd orthogonal group. 

There is only one regular nilpotent class in 5o(V ,q); take N to be any element therein. 
Upon extension by zero, it is regarded as a nilpotent element in 5o{V,q). By [38, §1] we know 
N is regular nilpotent in so(y, q), and any regular nilpotent element arises in this manner. 

Now begins the construction of N. Choose a basis e±i, . . . , e±m of mM such that 

q^{ei\ej) = 6i-j, -m <i,j <m. 
Choose V in the underlying space of (y) such that q (v) = y. Set 



Nci = ej+i, 1 < i < m, 




Vera = V, 




Nv = -ye-m, 




Nci = — ej+i, —m <i< 


-1 



Ae_i = 0. 

One checks that N is regular nilpotent in 5o{V ,€[). A simple calculation yields N'^^ei = 
(— l)™'ye_i and N'^"^x = for every other element x in the basis of V . Hence 

(8) Viv,q) ■■= q\e^\N^^-'ei) = (-1)"-^^ • g'(ei|e_i) = (-1)""^^. 

Lemma 4.4.5. With the notations above, 'Hrv^q) ca?^ he (—1)""^ times any nonzero element 
represented by {V',q'). 

Proof. This has just been done for n > 1. When n = 1, we have {V',q') = {V,q) and the 
assertion is true by definition. D 
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The formula for G = SO(y, q) The crucial tool in this article is the following formula of 
Waldspurger. Let iV^q) be an F-quadratic space of dimension 2n such that SOiV^q) is quasis- 
plit. We associate the simple endoscopic datum (2n, 0,x) of GL(2n) to SO{y,q) as in Remark 
14.1.21 Fix the -F-splitting of GL(2n)g chosen in Lemma 14.4.41 Hence one can unambiguously 
talk about correspondence of regular semisimple classes and the transfer factor. 

Theorem 4.4.6. Let 5 G GL(2n), regarded as a non- degenerate bilinear form on F^", and 
7 G SO(y, q) such that 7 is very regular and 7 -H- (5. Define a quadratic form qs on -F^" by 



5(« + *j) 



{v, v') I—)- -{6iv\v') + 5{v'\v)) 



If there exists an F-splitting for SO{V,q) such that ??(v,g) = "1? then 

1—1, otherwise. 

Proof. In view of Lemma l4.4.4^ this is an immediate consequence of [37, §1.11 (2)]. The factor 
i is missing in [37]. D 

Note that the non-degeneracy of qs follows from the fact that 6 is very regular; see Definition 
1123] and Remark HXn 

To get rid of the dependence on {V,q) and the F-splitting of SO(y, g), we write {V,q) ~ 
(n - 1)11 e {V, q') as in dZl). Write 

{V',q')=cNK/F 
where 

• i^ is either the etale F-algebra F x F, or a quadratic extension of F; in either case, r 
denotes the nontrivial element in AxiipiK) and N^/f is the norm form on K, characterized 

by 

V I—)- Nj^/p{v) = vt{v), V £ K. 

Note that K is uniquely determined by SO(y, q). When K = F x F, we have N^/f — cN^/f — 
M. 

Let (Vi,(7i), (V2,g2) be two F-quadratic spaces. We write {Vi,qi) ~ (^2,^2) if they have 
the same image in the Witt group over F. 



Corollary 4.4.7. For ^ -H- 5 as before, we have 

A(7,5) = 



1, z/(F2«,g5)^^"(-iriV^/^, 



1—1, otherwise. 

Proof. For any F-splitting of SO(y,q) with associated ??(y,g), we take t := —rKy^y Using the 
same F-splitting, we get 
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Thus Theorem 14.4.61 is apphcable. It remains to interpret the condition qs — {V,tq). As 

{V,q) ~ cNx/F = (^')'?')) the elements in F^ represented by {V',q') is cNj^ip{K^) (this 
holds trivially when K = F x F). Hence for any choice of F-splitting of SOiy,q), we have 



iVM) ~ tcNK/F = -{-IT~'c^Nk/f{K'') ■ Nk/f 

= (-l)"iVx/F 

by using Lemma l4.4.5[ 

Now Witt's theorems imply that qs ^ iV,tq) if and only if qs ~ {—l)"'Nj^/p, as required. 

D 

4.5 Geometric transfer 

The constructions below are due to Arthur [21 [3]. 

The twisted side Define 

ri.eg(GL(2n)) := {strongly regular semisimple conjugacy classes in GL(2n, F)}, 
rreg,eii(GL(2n)) := {6 G rreg(GL(2n,F)) : 6 is elliptic}. 

Choose Haar measures on GL(2n,F) and on the centralizers GL(2n,F)s for each 5 G 
rreg(GL(2n)), so that the orbital integrals are well-defined. Set CQ°(GL(2n, F)) to be the vector 
space of functions / G C^{GL{2n,F)) such that I^^'^'^^dJ) = for ah 6 G rreg(GL(2n)). 
Define 

(9) X(GL(2n)) := C^{GL{2n,F))/C^{GL{2n,F)). 

Elements in X(GL(2n)) can be seen as as functions on ri.eg(GL(2n)): 6 i— )• l'^^^'^"'{6, f), where 
/ is fixed. It can also be viewed as the quotient of C^(GL(2n, F)) by the subspace spanned by 
functions P - f, where / ranges over C^(GL(2n, F)) and P{6) := f{y5y~^), y G GL(2n,F). 
This follows from the twisted version of the density of semisimple regular orbital integrals. To 
prove this, it suffices to reduce to the corresponding result on Lie algebras [12, Lemma 4.1] 
using twisted descent [Ml 2.4]; see also [221 Proposition 4.1.5]. 

A function / G C^°°(GL(2n,F)) is called cuspidal if lGL(2n)(^^ j^= q for all non-elliptic 
5 G ri.cg(GL(2n)). This notion only depends on the image of / in X(GL(2n)). Define 

(10) Xcusp(GL(2n)) := {/ G X(GL(2n)) : / is cuspidal}. 

The endoscopic side For any {no^ng^x) G (?cii(2ra) with endoscopic group G, we set 



TreglC) 
rreg,ell(Cr) 

Ai-cg(G) 
Areg,cll(G) 



{very regular semisimple conjugacy classes in G(F)}, 
{7 e rreg(G) : 7 is elliptic}, 
rreg(F) /stable conjugacy, 
rrcg,eii(i^) /stable conjugacy. 



Recall that very regular elements have connected centralizer by Proposition 14.2.21 To define 
stable orbital integrals, we choose Haar measures on G{F) and on the maximal tori in G, 
such that if 71,72 G Ai.eg(G) are stably conjugate up to Out2n(G), then the isomorphism 
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G^^(F) ~ G-y^{F) preserves Haar measures. Such choices are possible. For / € C^{G{F)) and 
7 G Aj.cg{G), we can define the normahzed stable orbital integral 

5^(7,/) :=J: 1^(7',/) 

7' 

where 7' ranges over the conjugacy classes in the stable conjugacy class 7. 

As before, set C^(G(F)) to be the vector space of functions / G C^{G{F))) such that 
lG{jJ) = for ah 7 G rreg(G) and define I{G) := C,°°(G(F))/C^(G(F)). There is a stable 
variant, namely set C^{G{F)) C G^{G{F)) to be the subspace of those / satisfying 5*^(7, /) = 
for all 5 G Arcg(G); define 

(11) 5X(G) := G^{G{F))/C'^{G{F)). 

There is a surjection I{G) -^ SX{G). The algebraic dual of SI{G), regarded as a space 
of invariant distributions on G{F), is by definition the space of stable distributions on G{F). 
Elements in SI{G) can be seen as functions on Ai.eg(G'): 7 1— )• /S"^(7, /); as in the previous case, 
an element in SX{G) is called cuspidal if its restriction on non-elliptic stable classes is identically 
zero. Define 

(12) 5Xeusp(G') := {/ G S1{G) : f is cuspidal}. 

The group Out2n(G) acts on conjugacy classes, therefore one can define 

,,ell(G)/0ut2„(G), 

MG)/0nt2n{G), 



-■- rej 


,iG) 


= rreg(G)/0ut2„(G), 


rreg,ell(G') : = 


r 


Ares 


rSG) 


= Areg(G)/0ut2„(G), 


Areg.el^G) : = 


Arcg 








X(G) := 


= X(G)°"*2"(^), 










SI{G) := 


= 5X(G)0^*2n{G)^ 










SI cusp [G) := 


= 5Xeusp(G)0"*2"(^) 




The elements 


in SI{G) 


can thus be viewed 


as functions on Ai.eg(G) 



Compatibility of measures Summing up, we have chosen Haar measures for the groups 
below: 

• GL(2n,F), G{F); 

• Tg{F), T{F)/0, T/q{F), for every maximal torus {T,T) of GL(2n); 

• Tg{F), for every maximal torus Tq of G. 

Here G ranges over all elliptic endoscopic data of GL(2n). 

Definition 4.5.1. The Haar measures above are said to be compatible if the following conditions 
hold. 

1. The Haar measures on Tq{F)^ T{F)/q, T/q{F) are compatible in the sense of ^3.4[ More- 
over, they are compatible with stable conjugacy of maximal tori in GL(2n). 

2. The Haar measures on Tg{F) are compatible with stable conjugacy of maximal tori in G. 

3. Suppose 7 G Arcg(G), 5 G rreg(GL(2n)), 7 o 5. Set Tq := G^ andT := Z^,^AGh(2n)i), 

then Tq = GL(2n)5 and twisted endoscopy provides an isomorphism Tiq — >• Tq- We assume 
that the Haar measures on Tg{F) and Tq{F) match under these identifications. 

This is the convention in [34, 3.10]. It differs from that in [17, 5.5] by a harmless constant. 
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Langlands-Shelstad-Kottwitz transfer Assume that a 0-stable F-splitting of GL(2n) is 
chosen so that the associated -F-sphtting of GL,{2n)g is as in Lemma 14.4.41 Prom this we 
fabricate a 0-stable Whittaker datum {B, A) and the Whittaker-normahzed transfer factor A;^ 
for each G (see Definition 14. 4. 2p . 

Theorem 4.5.2 (Ngo [23]). For every {no,ns,x) ^ '?eii(2n.) with endoscopic group G, there 
exists a map 

X(GL(2n)) -^ 'ST{G) 

characterized by the equation 

(13) 5^(7,/'')= E Aa(7,c^)/^^('")(5,/), 7eAreg(G). 

5errcg{GL(2n)) 

Here the orbital integrals are defined using compatible Haar measures in Definition 14.5.11 
By using this theorem, we look upon 7 1— )■ 5*^(7, f'^) as functions on Ai.eg(G). 
Varying endoscopic data, we set 



rf,g,ell(GL(2n)) := y A2„_.eg,ell(G), 
G 

xLp(GL(n)):=0SZ,,,p(G). 



G 
where 

• by abuse of notation, G ranges over elements in £^ii(2n) for which G is the associated 
endoscopic group; 

• A2n-reg,eii(G) signifies the set of elements in Ai.eg,eii(G') that correspond to some strongly 
regular semisimple element in GL(2n,F). 

The correspondence 7 -H- 5 induces a correspondence between F^ g[[(GL(2n)) and ri.eg,eii(2n), 
since it preserves F-ellipticity [17, 5.5]. The Whittaker-normalized transfer factors of various G 
also merge into a single factor 

Aa : rf,g^,ii(GL(2n)) X r,eg,eii(GL(2n)) ^ C 

such that Aa(7, 5) 7^ if and only if 7 o (5. 

Theorem 4.5.3. The transfer maps f 1— )■ /'-' induces an isomorphism 

Xcusp(GL(2n))^xLp(GL(n)) 

/^ /':=(/%• 

Proof. This is "the second crucial step" in the proof of [31 Proposition 2.1.1], pp. 58-59. D 

Rewriting (|13p . the isomorphism / 1— )• /' is characterized as follows 

(14) S(7,/')= E Aa(7,5)/^^('")(5,/), 7 G rf,g,,u(GL(2n)), 

<5errcg(GL(2n)) 
7-f4(5 

where we define ^(7, /') := ^^(7, f^) if 7 e A,eg,eii(G). 
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5 Crude local Langlands correspondence for orthogonal groups 

5.1 Selfdual L-parameters 

This is mainly a review of well-known results in order to fix notations. Let A^ G Z>i- Recall 
that WDf :=Wf xSU(2). 

Definition 5.1.1. A L-parameter for GL(A^, i^) is a semisimple, continuous representation 

0: WDi7^GL(iV,C) 
taken up to equivalence, i.e. up to GL(A^, C)-conjugacy. 
Introduce the nested family of L-parameters as follows. 



{L — parameters of GL(A^, F)}, 

{(p e $(GL(7V)) : (/) has bounded image in GL(iV,C)}, 

{</> e $bdd(GL(7V)) : irreducible}, 

{(p G ^2,bdd(GL(iV)) : <^|ixsu(2) = !}• 

Denote the contragredient operation of L-parameters for Gh{N,F) by i;^ i— t- (p^ . It preserves 
each of the subsets above. 
On the other hand, define 



$(GL(iV)) 

$bdd(GL(iV)) 

$2,bdd(GL(Ar)) 

^sc,bdd(GL(Af)) 



n(GL(iV)) 

ntemp(GL(Ar)) 

n2,temp(GL(7V)) 
nsc,temp(GL(Ar)) 



{smooth irreducible representations of GL{N,F)}/ ~, 
{vr G n(GL(iV)) : vr is tempered}, 

{vr G ntemp(GL(A^)) : vr is essentially square-integrable} , 
{vr G n2,temp(GL(A^)) : vr is supercuspidal}. 



Recall that a tempered irreducible representation is unitary. 

Now we can state a small portion of local Langlands correspondence for GL(A^, L"). 

Theorem 5.1.2 ([l3l[T3|). There is a canonical bijection between ^{GL{N)) and Il{GL{N)) , 
written as (p ^ tt, such that 

1. when N = 1, the bijection is given by local class field theory; 

2. for -f-)- vr, the central character uj-,^ : F^ — )• C^ of n corresponds to deto<^ : WDp — )• C^; 

3. (f)^ o vr^ if and only if (p -^ vr; 
4- the correspondence matches 

$bdd(GL(Af)) ^^ Utemp{GUN)) 
^2,bdd(GL(Af)) ^^ n2,temp(GL(iV)) 
$sc,bdd(GL(Af)) ^^ nsc,temp(GL(iV)). 

Remark 5.1.3. The correspondence can be characterized by further properties, namely the 
matching for Rankin-Selberg L-functions and e-factors; see p!5] for details. 

Let (j) G <I>(GL(A^)). Call (p selfdual if ~ (p"^ . Selfdual (p have an unique decomposition into 
subrepresentations of WD^?: 



(15) ^=^ii(p^®^ij 

where 



ecAj) 
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• the representations {(l)i)i^j^ are irreducible and distinct, idem for {(j)j)j^j^; 

• 4>y ~ (j)i for all i G If, 

• 4)) i^ (t>j for all j e Jf, 

For each i ^ I^ as above, there exists an isomorphism fi-.cpi^-cj)^. By identifying (j)^^ = (j)i 
and consequently /^^^ = /j, we see that there exists a well-defined sign sgn(0j) = ±1 such that 
/V = sgn((/)j)/j for every choice of /j. 

We write 

$bdd(GL(A^)) := {</) G $bdd(GL(A^)) : </> ~ </>V}, 
$eii,bdd(GL(Ar)) := {0 e (|.bdd(GL(Af)) : J^ = 0, Vi E /^, ^^ = 1 in m)- 

Remark 5.1.4. To justify our notation, let us show how to associate a representation (vr, vr, V) 
of GL(iV, F) to a G $bdd(GL(^))- Fix an element 5 G GL{N, F) such that 8 := Ads fixes a 
Whittaker datum (B,X). We have the notion of (i?, A)-generic representations [28, Definition 
3.1.2]. Take (vr, V) G ntemp(GL(A^)) such that </> f-)- tt, then (vr, V) is selfdual. Jacquet's theorem 
|16j asserts that tempered representations of GL(A^, F) are {B, A)-generic. Hence we can define 
vf by requiring that A := tt{6) satisfies tto9 = AttA~^ and ujo A = co for every (B, A)-Whittaker 
functional lo of vr. Conversely, every strongly irreducible representation {7r,TT,V) of Gh{N,F) 
with tempered vr is so obtained up to equivalence. 

5.2 Spectral transfer 

The setting Henceforth we specialize to A^ = 2n and study the parameters (j) G <I>cii,bdd(GL(2n)). 

Write (j) = 0jg7 (pi as in (fT5|) . Every cpi is viewed as an element in <l>eii,bdd(GL(nj)) for 
some Hi. Set Xi '■= deto^j g $bdd(GL(l)), it can be regarded as a continuous homomorphism 
Tp — )■ {±1} by the self-duality of (pi. Note that sgn((/)j) = —1 implies Xi = 1- 

Consider an elliptic endoscopic datum {no,ns,x) ^ SeuC^^) with endoscopic group G = 
SO(y, q) X SO{ns + 1). Define 



n(G) 
n2(G) 

n(G) 
ThiG) 



{tt : TT is an irreducible smooth representation of G{F)}/ 

{it G H(G) : vr is square- integrable} , 

n(G)/Out(G), 

n2(G)/0ut(G). 



In ^4.51 we have defined the spaces I{G), I{G). Since Out(G) = Out2n(G'), we have I{G) 
•2;^(^^Out{G) Yix a Haar measure on G{F). Each a G H(G) defines a linear functional 

G^ : T{G) -^ C 

f{x)TT{x)dx I , 



/ ^ e^(/) = tr I 

\G(F) 



where a is any inverse image of a in H(G). 



28 



Now we define the L-parameters corresponding to elements in Il2{G). Let 4> S ^eii,bdd(GL(2n)) 
with the decomposition ()15p . Define 

I^ := {i£l^: sgn{(pi) = 1}, 
/^ := {ie I^: sgn(0i) = -1}. 

Recall the Remark 14.1.21 that x is a continuous character Tp — )• {±1} which determines 
SO{V,q). Define 



(16) $2(G) := < 



G $ell,bdd(GL(2n)) ■.\I^\=ns, ]]_ Xi = X 



> . 



Therefore 

(17) $eii,bdd(GL(2n)) = |j¥^(G). 

G 

Moreover, (j) gives rise to 

(po := 0i G ^ell,bdd(GL (no)), 



^S := </>» G ^cll,bdd(GL(n5))- 



i&U 



The crude correspondence Let G be an elliptic endoscopic group as above. Fix the ^-stable 
-F-splitting and Whittaker datum as in ^4.51 Choose compatible Haar measures in the sense of 
Definition [i311 



Theorem 5.2.1 (Arthur, ^ Theorem 1.5.1 and 2.2.1]). For each (f> € <1>2(G), one can canoni- 
cally associate a nonempty finite subset liff, ofIi2{G), such that 

1. there is the disjoint union 

n^(G)= y n^; 

2. the linear functional on X{G) 

factors through ST{G), i.e. 09 is a stable distribution; 



3. let f I— >• /*^ be the transfer map from X(GL(n)) to ST{G) in Theorem 4-5. 2\ if it ^ 
ntemp(GL(2n)), (/) o TT, then ^ 

ef(^")(/) = e^(/«) 

for all f £ X(GL(2n)), where fr is the representation ofGL{2n,F) defined in Remark 
\5M 
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4. set Go ■■= SO{V,q), Gs := S0(iV5 + 1), if f^ admits a decomposition f^ = f^o ^ fGs 
with f^o £ ST{Go), f^"" G SI{Gs), then 

The last assertion is trivial for simple endoscopic data. Moreover, II^ is characterized by 
these properties; see [Sj Remark 1 after Theorem 2.2.1]. 

Remark 5.2.2. To see why this furnishes a local Langlands correspondence, one should regard 
the L-embedding ^ : ^G "^ GL(2n, C) x Wp given by twisted endoscopy. This is explained, 
for example, in [371 1.8]. The correspondence is crude in the sense that G can admit an extra 
symmetry in ^GL{2n) if Out(G) / {1}. See also [17, pp. 18-19]. 

Definition 5.2.3. Let (/> G $eii,bdd(GL(2n)). We say that </> comes from G if </> G ^2{G). Let 
vr be a selfdual representation of GL(2n,i^), we say that vr comes from G if vr o for some (j) 
coming from G. 

By ()17p . (f) comes from exactly one G. 

5.3 Character relations 

The aim of this subsection is to establish a twisted case of [21 Corollary 6.4] that relates character 
values. Retain the notations in the preceding subsection and use compatible measures prescribed 
in Definition 14.5.11 

Measures and integration We set up a convenient integration apparatus as in [2]. The 

sets ri.eg,eii(GL(2n)), Ai.eg,eii(GL(n)) acquire quotient topologies from GL(2n)i.eg. Define Radon 
measures on these spaces by requiring that 

(18) / a{5)d5 = ^\WiGL{2n,F),f{F))\-^ f a{t)dt, 

r,eg,cii(GL{2n)) ^ T{F)/e 

(19) / a'{6')d6' = ^\W{GL{2n),f){F)\-^ f a'{t)dt, 



A,,g,,n(GL{2n)) ^ T^e(F) 

where a G Cc(ri.eg,eii(GL(2n))), a' G Cc(Areg,cii(GL(2n))); the T ranges over conjugacy classes 
and stable conjugacy classes of elliptic maximal tori in GL(2n), respectively. The measures on 
T{F)/g, T/g{F) and Tg{F) are related as in gSS 

Write 5 I— )• (5' if 5 lies in the stable conjugacy class 6' . It follows easily from the definitions 
above that 



/ .fe^"'^ / 



(20) / {y^a{6)]d6'= I a{6)d6, a G Ce(rreg,eii(GL(2n))). 

A,og,cii(GL(2n)) ~"' '" ' r,eg,eii(GL(2n)) 
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Using similar notations, define Radon measures on rreg,eii(G'), Areg,eii(G') such that 

(21) I f]{^)dj = Y,\W{G{F),Tg{F)\-' I /3{t)dt, 

(22) J ^'{j')d^' = Y,\WiG,TG)iFr' J /3'(t)dt, 

A,eg,oll{G) ^G Tg{F) 



(23) I f j;/3(7)j d7'= I 

Arcg,oll(G) \' ' / ri.og,Gll(< 



/3(7)d7, 

g,Gll(G) 

where /3 e C,(rreg,cii(G)), /?' G C7,(Areg,eii(G)). 

Equip rreg,eii(G), Ai.cg.cii(G') with quotient measures by Out2n(G); we can also replace 
Areg,eii(G) by its Open dense subset A2n-reg,cii(G'). By taking disjoint union, we obtain a Radon 
measure on rfggg[[(GL(2n)). 

The following result is a twisted analogue of [2, Lemma 2.3]. 

Lemma 5.3.1. Suppose the Haar measures are compatible in the sense of Definition \4 ■ 5~ , Let 
a G Ce(rreg,eii(GL(2n))), /3 G C,(rf,g_,u(GL(2n))), then 



I Y. /3(7)Aa(7,'5)«('5)J d<5 

r.G„Gn(GL(2n)) Verf,,,n(GL(2n)) 



/ Y._ /3(7)A,(7,<5)a(5)| d7. 

rf^ ^ii(GL(2n)) \'56r,eg.eii(GL(2n)) 



Proof. Using (j20p . the left hand side transforms into 

/ \ 

^/3(7)AA(7,5)a(5) 



/ 



Gii{GL(2n)) 



1 7.<5 , 



dy. 



Recall that the correspondence 7 o (^ is really determined by the stable conjugacy class b' 
such that b 1— t- b' ] write this correspondence as 7 -f-T- b' . To conclude, we claim that the right 
hand side is equal to 



/ 



^/3(7)AA(7,5)a('^)) d5'. 

1 7<-4(5' 



Indeed, it suffices to concentrate on only one endoscopic group G at a time. We transfer 
the classes between A2n-reg(G') and Ai.eg(GL(2n)) using the maps Tq —^ Tig mentioned in 
Definition 14.5.11 where Tq d G,T C GL(2n) are appropriate elliptic maximal tori; it factorizes 
into a map between F-varieties Tg/W{G,T) — )• TiQ/W{GL{2n),f). Taking F-points induces 

a well-defined map H : A2n-rcg(G') — )• Ai.cg(GL(2n)), which is locally a homeomorphism. We 
have seen that it factors through the Out2n(G)-action. 

Observe that only those elements b' in the image of H contribute to the integral because 
of the presence of Aa(7,(5). By Definition 14.5. H the change of variables by A2n-reg,eii(G') ^ 
Ai.eg,eii(GL(2n)) has jacobian equal to 1, whence the claim. D 
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Character values Let A^ be a linear functional SX{G) —J- C. There is a canonical way to 
extend Ac to SZ{G), namely by setting 

(24) Ag-.J^Ag'^^"^^^ 



where s is the nontrivial element in Out2n{G) if Out2n{G) 7^ {1}; otherwise take s = id. 
Thus Ac can be viewed as an invariant distribution on G{F). We say Ag is represented by 
a locally integrable function (resp. locally constant on GregiF)) if Ag is. Note that when Ac 
is represented by a locally integrable function, the invariant function is necessarily Out2n(G')- 
invariant. 

In particular, the linear functionals G9 defined in Theorem 15.2.11 are represented by locally 
integrable functions which are locally constant on G^cgiF). 

Consider now a linear functional A' = {Ag)g on 0^ SI{G). We say A' is represented by a 
locally integrable function, etc., if each component Ac is. If it is indeed the case, we will view 
A' as a function on \_\q Areg(G). One can also speak of its restriction to rf g[[(GL(2n)). 

In the same vein, define the Weyl discriminant D' = {D^)g as a function on IJ^-, Ai.eg(G). 

Proposition 5.3.2. Let A (resp. A' = [Ag)g) be a linear functional on X(GL(2n)) (resp. 
ff)r< SI(G)). Assume that A'L^ ,^^/„ nn transfers to AL ,frf ,r, ^^ in the sense that 

A'(/') = A(/), / G X,,3p(GL(2n)), f^f = (/^)g; 

cf. Theorem \4. 5. 3\ If A, A' are both represented by locally integrable functions which are locally 
constant on regular semisimple elements, then 

|^GL(2n)(^)|l^(^)^ ^ |D'(7)|U'(7)Aa(7,<5), <5 G r,eg,eii(GL(2n)). 

76rf,g,eii(GL(2n)) 

Proof. In what follows, we treat all G simultaneously by using the language in Theorem 14.5.31 
and ([HD. ^ ^ 

Take / G Xcusp(GL(2n)). By Proposition l3.4.2] and the definition of measures on ri.eg^eii(GL(2n)), 
we have 

A(/)= / |L>^(2n)(^)|i^(^)jGL(2n)(^j^^^^ 

rrcg.en(GL(2n)) 

Similarly, the untwisted case of Proposition [3331 applied simultaneously to each G, implies 



A'(/')= y |Z?'(7)|^A'(7)S'(7,/')d7. 

rfeg,cii(GL(2n)) 

Applying dH]), A'(/') is equal to 

I |D'(7)|5A'(7) Y. A;,(7,5)lG£(2«)(5,/)d5. 

rfog,oii(GL(2n)) 5er,eg,oii(GL(2n)) 

Now we can apply Lemma 15.3.11 to get 

A'(/')= / Y. |1?'(7)I^A'(7)Aa(7,5) /^L(2")(5,/)d7. 



r,,,,,n(GL(2n)) V76rf,,,en(GL(2n)) 
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Let Sq G rreg,eii(GL(2n)). Replace / by a sequence {/i}^i in Xcusp(GL(2n)) such that 
jGL(2n)|-. y^-j approaches the Dirac measure concentrated at (5o as i — )• cxd, then the equahty 
A(/j) = A'(/j') and the equations above show 

7erf,g,,n(GL(2n)) 

as asserted. D 

For (f) e ^(G), define 

Corollary 5.3.3. Let n G ntemp(GL(2n)) be selfdual with L-parameter (p E $eii,bdd(GL(2n)). 
Let G he the elliptic endoscopic group such that (j) £ <I>2(G), then 

jGL(2n)(~^^)^ ^ 5^(<A,7)Aa(7,'^), <5 G rreg,eii(GL(2n)). 

iJere vf is the representation of GIj(2n, F) defined in Remark \5.1.4\ 

Proof. Take A' := 09, regarded as a hnear functional on ^q SX{Gi) concentrated at the 

G-slot. By Theorem EJH A'(/') = A(/) for ah / G X(GL(2n)). Now Proposition [Oj] can be 
applied. D 

These character identities are independent of choice of Haar measures. 

6 The Goldberg-Shahidi-Spallone formalism 

The setting below is modeled upon [31j, corresponding to the special case "n = 27Ti" (resp. 
"n = 2m + 1") in the terminology of [SI [9] (resp. of [ID]). 

6.1 Sesquilinear algebra 

Let E/ F be a field extension with \E : F] < 2. As usual, set r to be the nontrivial element in 
Gal{E/F) if [E : F] = 2, otherwise r := id. Fix e = ±1 and consider a (£^, r)-hermitian space 
iVi^qi) of sign e. There are four cases. 

1. Even orthogonal case: E = F, e = 1, dimj? Vi = 2k for some k. 

2. Odd orthogonal case: E = F, e = 1, dirap Vi = 2/c + 1 for some k. 

3. Symplectic case: E = F, e = —1. 

4. Hermitian/anti-hermitian case: [E : F] = 2. 

Assume that there exists a decomposition of iiJ-vector spaces 

Vi = H'®V®H 
such that 

• dim^; H = diuiE H' = dim^; V\ 
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• H, H' are totally isotropic in Vi ; 

• set q := qi\v, then (V^q) is a £'/F-hermitian space of sign e; 

• y is orthogonal to H (B H'; 

• in the even orthogonal case, {V, q) is not isotropic of dimension two. 

This leads to an identification H' = H'^ , namely an element v' G H' corresponds to the i?-linear 
functional 

V I — )■ q{v'\v), V £ H. 

Henceforth we abandon the notation H' and write H"^ instead. Note that for Y G HouiEiH, H"^) '- 
EndE{Vi), the adjoint map of Y with respect to qi is then identified with eY : H ^ H"^ . 

Set Gi := \J{Vi,qi)°. Given the decomposition above for Vi, we define the following sub- 
groups of Gi : 



P 
P- 

M 



StahcAH''), 

StahoAH), 

PnP- = GLe{H) X \j{v, qy. 



The groups P, P~ are maximal parabolic subgroups of Gi with the common Levi component 
M. Write P = MU, P~ = MU^ for the corresponding Levi decompositions. 

Write a[q] for the element in Isom£;(y, F"^) corresponding to q, that is, {a[q]v,v') = q{v\v') 
for all V, v' G V. 

Proposition 6.1.1. The elements ofU are in natural bijection with pairs {X,Y) such that 

XGHoms(y,F^), 
Y eUomE{H,H''), 

and 

(25) Y + eY + Xa[q]-^X = 0. 

More precisely, given {X,Y) as above, set X' := —cj[q]^'^X G Hom£;(//, 1/). Then {X,Y,X') 
defines an element n{X,Y) G End£;(yi) such that n{X,Y)\H = Y + X' , n{X,Y)\v = X, 
n(X, y)|//v = 0. The corresponding element is u{X,Y) := 1 + n[X,Y). 

Proof. This is [311 §2.1]. D 

Introduce the twisted space {G\je{H),G1je{H)) of non-degenerate iiJ/F-sesquilinear forms 
on H (recall ESD- 

Lemma 6.1.2. Let U' be the Zariski open dense subset ofU consisting of elements of the form 
u{X,Y), in the notation of Proposition WIl.R such that X,Y are both invertible. There is a 
canonical isomorphism between F-varieties 

. 5:£GLEiH), 



U' ^\{6,ip). ^ ^ ison,^^^((^^ s + e- *5), (V, -eq)). 



u{X,Y) 



5 : {v,v') i-> {Yv,v') 
^^■.= a[q]-^X. 
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Proof. By recalling our identification H = H'^'^ and the definition of *5, one sees that *5{v\v') = 
t{Yv',v) = {Yv,v'). By the same reasoning, one can rewrite ()25p as 

{{Y + eY)v, v') = -{X(j[q]-^Xv, v') 
= -T{Xv',(T[q]-'^Xv) 
= -T{cF[q]Lpv' ,ipv) 
= —Tq{ipv'\ipv) = —€q{ipv\ipv') 

for all v,v' G H. The invertibility of y + eY follows automatically. This is enough to complete 
the proof. D 

6.2 GS-norms 



Definition 6.2.1. Let {X,Y) be as in Proposition I6.1.T] such that X,Y are both invertible. 
Define the Goldberg-Shahidi norm (abbreviated as GS-norm) by 

(26) Norm(X, Y) := I + a[q]~^XY-^X G EndE{V). 

We also regard Norm as a morphism U' — )• End£;(y). 

We will identify lsom.E{H,H'^) and GLe{H) by sending Y : H ^ H^ to the sesquilinear 
form 5y '■ iv,v') i— >• {Yv,v'). 

Theorem 6.2.2 ( |3H §3, §5]). The morphism Norm has the following properties. 

1. The image of Norm is {7 € \]{V.,q) : det(7 — 1) 7^ 0}; this subset is contained in 
— 1 • U(y, g)° if {y,q) is odd orthogonal, otherwise it is contained in \]{V,q)° . 



2. Let {X^Y) he as in Proposition \6.1.1[ g £ GLe{V), then {gX,gYg) also satisfies ()25p . 
and 

Novm{gX,gYg) = Norm(X,y). 

3. Let X G lsoniE{V,H'^), then the morphism 

(27) 7 ^ 6xh) ■■= X(7 - iy^a[q]-^X e IsomEiH, H^") 

is a section of Norm. 
^. Norm induces a surjection 

GLe{H)\{5 G GLe{H) :6 = 6y for some {X, Y) from U'} B {X, Y) 



U(y,(z)\{7GU(y,(z):det(7-l)/0} 
where GLe{V) (resp. \]iy,q)) acts by conjugation. 
Let 6 £ GLEiH), 7 G \]{V, q), we will write 

J GS 

— > 7 

if their conjugacy classes correspond as in the last assertion. 



3 Norm(X, Y) 
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Proof. These assertions are essentially due to [SJ O [TU] and proved in [3T] using a coordinate- 
free approach. Note that in the last assertion, the GL£;(ff)-action is well-defined by the second 
assertion and ([S]). D 

The crux is to compare the GS-norm with the correspondence of conjugacy classes in twisted 
endoscopy. This is done in [8l|9l[l^ using the language of [17], in a broader context. Our concern 
here is to describe Norm directly in terms of twisted spaces and the parametrization in ^4.2[ This 
will also give a transparent explanation for Theorem 16.2.21 at least for very regular semisimple 
classes. 

First of all, as the map in the last assertion of Theorem 15.2.21 is obtained from a morphism 
between F- varieties, we actually get a map between stable conjugacy classes. Let 5 G GLe{H) 
be very regular semisimple. We invoke the parametrization in 



1. In the odd orthogonal case, the stable conjugacy class of 5 is parametrized by a quadruplet 

{L,L±,x,xd); 

2. In the remaining cases, the stable conjugacy class of 5 is parametrized by a triplet 
(L,L±,x). 

Lemma 6.2.3. Let 5 £ GhE{H) be very regular semisimple, such that 5 = 6y for some (X, Y) 
satisfying ()25p . Assume that the stable conjugacy class of 5 is parametrized by {L,L±,x) (resp. 
{L,L±,x,X£)) in the odd orthogonal case). 

1. In the odd orthogonal case, suppose that (—1) • Norm(X, y) is very regular semisimple in 
SO(y, g), then its stable conjugacy class is parametrized by {L,L±,y) where 



2. In the remaining cases, suppose that Norm(X, y) is very regular semisimple in \J{V,q)° , 
then its stable conjugacy class (up to 0(y,q) in the even orthogonal case) is parametrized 
by {L,L±,y) where 

er(x) 

y = • 

X 

Since very regular semisimple elements form Zariski open dense subsets, the condition in 
this lemma holds generically. 

Proof. We start from the second case. Implicit in the parametrization of 6 is an identification 
H = L as S- vector spaces. We deduce an isomorphism ip^ ■ H'^ = L^ ^ L, characterized by 

(28) {v,v)=iiLiE{T{^Lv)v), veL'',veL. 

Since 5 is very regular, we have 6 + e ■ ^6 G GLe{II). Moreover, Remark 14.2.11 affirms 
that (5 + e • *5 G GL^(//) is parametrized by {L,L±,x + er(a;)). This element corresponds to 
y -|- eY G Isom£;(//, /Z"^). Hence we have the following commutative diagram with invertible 
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arrows. 



V- 



XY-'^X 



-.yv -M"^ 



-^V 



X 



H"^ 



Y- 



, -(Y+tY) 



:i?- 



Vl 



y 



Vl 



L- 



, -(x+eT(x))- 

^L s-L 



where we have used (j25p . In view of the definition of GS-nornis in ()26p . we get the commutative 
diagram 

Norm(X,y) 

V ^—- — >v 



IPLOX 




fLoX 



{l-x-^{x+eT{x)))- 



We have 1 — x~^{x + eT(x)) = — ex~^r(x) = y. The parametrization in ^4.21 savs that (L, L±,y) 
parametrizes Norm(X, y). 

Consider the odd orthogonal case now. We have E = F, e = 1 and an identification 
H = L® F as F- vector spaces. In this case, we deduce an isomorphism of F- vector spaces 

99L = (V^i, v^i) : /7^ = L^ e F^ 4 L e F, 

where ^p\ : L^ — t- L is defined by (|28p and ip\ : F^ — >• F, or rather its inverse, corresponds to 
the quadratic form x i— >• x^ on F. 

As before, we obtain a commutative diagram 



<^[i]-' 




Hence 



{x,^d)- 



V- 



Norm(X,y) 



^V 



ipLoX 

L®F- 



{-x-^t{x),-1)- 



ipLoX 

^L®F 
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To conclude, it suffices to note that {—x ^t{x), —1) = — (y, 1). D 

Corollary 6.2.4. Suppose 6 G GLEiH), 7 G \J{V,q)° (resp. -7 e \]{V,q)° in the odd orthogo- 

GS — 

nal case) are both very regular semisimple. If S — > 7, then GLe{H)s ^ \J{V,q)^. In particular, 

6 is elliptic if and only if 7 (resp. —7 in the odd orthogonal case) is. 

Proof. The first assertion follows from the Proposition 14.2.31 and Lemma 16.2.31 The second 
assertion follows from the easy fact that the identity components of Z\jn/^q\o and Zgf ,y. are 
both anisotropic. D 

Corollary 6.2.5. In the even orthogonal case, suppose 6 £ Gh{II), 7 G SO{V,q) are very 
regular semisimple. If 5 — > 7, then 5 corresponds to j~'^ (or equivalently 7J in the sense of 
twisted endoscopy for Gh{II). 

Proof. Compare Lemma 16.2.31 and Definition I4.2.4[ Note that 7 and 7"^ are stably conjugate 
up to 0{V,q). Indeed, their parameters {L,L±,y), {L,L±,T{y)) are equivalent via r. D 

6.3 Transfer factor in the even orthogonal case 

We rejoin the setting of ^4.41 in this subsection, namely we consider an F-quadratic space (V, q) 
such that dimi? V = 2n = diuip H and SO(y, q) is quasisplit. Regard SO(y, q) as an endoscopic 
group of GL{H) for some (2n, 0,x) £ '?sim(2re). Choose a basis for H and fix the 0-stable 
Whittaker datum (B, A) of GL{H) as in ^4.41 by which the Whittaker-normalized transfer 
factor A A is defined. 

As usual, we set K = FxFifx = ^} otherwise K is defined to be the quadratic extension 
attached to x- I^i either case, x 1— >• Nj^/p(x) denotes the norm form on K. Therefore we can 
write 

(29) {V, q)^{n- 1)EI cNk/f 

for some c G F^ /F^"^. 

' — ' GS 

Proposition 6.3.1. Let 5 G Gh{H), 7 G SO(yig) he both very regular semisimple. If 5 — > 7 

as in Theorem \6.2.SX then 

^x{l-\5)=^^,{2{-irq). 

Proof. Set q^ := ^{6 + ^6) as in Theorem l4.4.6l The assumption on (7, 6), Lemma [6. 1.21 together 
with Proposition 14.4.71 implv 

1—1, otherwise. 

However {V, -^g) ^" {-!)'' Nk/f if and only if {V, 2(-l)"-ig) ^" Nk/f- Put 

{V',q'):=in-l)meNK/F- 

It remains to decide whether (y, 2(— l)"~^g) ~ (y',q') or not. According to ([29]) . d±{2{—l)"^^q) = 
d±{q')i thus it suffices to compare their Hasse invariants s(2(— l)"^-*^*/) and s{q'). To this end 
we use [24^ Proposition 1.3.4], which implies 

A(7 ,5) = ,(2(-l)n-i,) = 7^^(2(-l)n^ig) = 7^.(iVi./i^)7^.(2(-l) q), 
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where we have used the fact that 7^^(-) factors through the Witt group. 
By Definition 14.4.21 and Remark 14.4.31 we arrive at 

as required. D 

6.4 Goldberg-Shahidi pairing 

We are now ready to introduce the integral pairing of Goldberg and Shahidi. Consider the 
general case 

• Gi, P, M = GLe{H) X U(y,g)°: as in ^A\ 

• wq: the nontrivial element in VF'^i(M) := Ng^^p-j{M{F))/M{F); 

• (vr Kl cr, y,r 'X' 14-): irreducible supercuspidal representation of M = GLe{H) x \J(y,q)° 
satisfying iuq • (vr Kl cr) ~ vr Kl cj; 

• (-B,A): a ^-stable Whittaker datum for GLe{H) (recall Definition 14.4.21 replace F hy E 
if necessary) . 

The condition wq ■ {tt ^ a) ~ vr Kl o" implies vr is unitary, hence tempered. Therefore tt can 
be canonically extended to a representation vr of GhE{H) by Remark 15. 1.41 

Let Hm '■ M{F) — )• aM,c be the Harish-Chandra map, A € a^/C' ^"^^ ^^* ('''" ^ '^)^ •" 
{ttM a) ® e^^'^Mi-)) ^ Denote the normalized parabolic induction of (vr M a)x by Xp^((vr M a)x). 
Choose a representative wq of wq in Gi{F). We want to study the residue at A = of the 
standard intertwining operator 

Jp(u.o,(irKl<j)j) :lg'({jrH£r);j)^lf'{(»El<T)i) 

x« / /(„V'-)d„ 

U{F) 

This integral is absolutely convergent if ReA lies in the positive chamber, for general A it is 
obtained by meromorphic continuation. 

In the study of Res\=Qjp{wo, (vrKlu);^), Goldberg and Shahidi were led to study an intricate 
pairing R : A{n) x A{a) — )• C between matrix coefficients (recall the definition of twisted matrix 
coefficients in ^3.3p using GS-norms, which has a regular (or elliptic) part i?eii that is defined 
as an integral pairing between orbital integrals. As mentioned in 311 the non-vanishing of i?eii 
is conjectured to be related to twisted endoscopic transfer [271 El 13 HO]- In view of Spallone's 
improved formulae [3H Corollary 6], -Reii is proportional to another pairing R , which we set 
off to define. 

Henceforth, we assume E = F m order to apply Spallone's formulae in \31\ §9]. 

Fix Haar measures on the groups GL(H), \J{V,q)°, Zjjf^y^q^o^F) and -^gl(h)(-^) = -^^• 
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Definition 6.4.1. Assume E = F. Let /s- G ^(vr), fa G A{cr). Define 
(30) R'^\h,fa)= Yl \W{UiV,qr,T{F))\-' J 

elliptic '^(^) 

^u(v,,)°(i^)\U{V,q) / \ Fx\GL{H) J 

where 

• T ranges over conjugacy classes of elliptic maximal tori in U(y^,g')°, whose measures are 
normalized so that vol(T(F)/Zu(v^q)o(F)) = 1; 

• (5 G Gh{H) is given by choosing X G Isomi;'(y, H'^) and setting 

J (^xl— 7)) in the odd orthogonal case, 
1 (^xIt), otherwise ; 

here 6x{-) is the section of GS-norm defined in Theorem I6.2.2[ 

This is the main object is this article. To justify the definition, let us show that R^^^ is 
indeed the elliptic part of the pairing in [31], up to a harmless constant. Write dimity = 2n 
(resp. 2n + l) in the even orthogonal or symplectic case (resp. the odd orthogonal case). Choose 
/* G C^{GL{H)) such that 



U{6) = j io^{z)-'f{z6) dz, 6 G GL{H),,g. 



F^ 



Spallone defined a pairing R{f^,fa) in |31[ Corollary 6]. Translated into the language of 
twisted spaces using ^3.51 the elliptic part of R{f^, fa) is 

00 » 

i?cll(r,/.):=Res,=oE9F'"'' E \WmV,qr,T{F))\-' J |DU(F,,)°(^)|||^GL(H)(^)|i 



elliptic ^ y^ ) 






y€T{F)\V{V,q) 

where Wk{x, y) is Spallone's weight factor. Here T is identified with Gh{H)s via Corollarv l6.2.4l 
We only need two properties of Wk{x,y): 

. 0<Wk{x,y)<Yol{T{F)y, 

• Wkixjy) converges to vol(T(F)) pointwise, for elliptic T. 

For each T, the corresponding sums inside ReSs=o are absolutely convergent when Re(s) > 0, 
by [301 Proposition 14]. 

Proposition 6.4.2. We have 



Rcwif^Ja, ^„„^, „ , ,_i 11 



{\2\p2n\ogqF) ^R {fir, fa), in the even orthogonal or symplectic case; 
2{\2\p2n\ogqF)~^R'^^'^{fji-, fa), in the odd orthogonal case. 
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Proof. The argument is almost identical to that in |29[ §3]. Fix an elliptic torus T in \J(y,q)° 
and write its contribution in Re\\ as ReSs=o X^fclo ^F " ''^fe- Then a^ is bounded by a linear 
combination of terms 

T{F) 

with Q G F^ /F^'^, whose absolute convergence follows from Proposition 13.4. 1] . 

From the dominated convergence theorem, one sees limfc_>oo o^ = or where a is the ex- 
pression 

\W{U{V,q)°,T{F))\-'^ I |DU{V'''')°(7)|5|DGL(//)(^)|i 
T(F) 



jj ^ a;^(a) ^r{ax ^5x)f„{y Sy)dxdyd7. 



i/eT{F)\U(y,g) 

Recall that vol(Zu(y^g)o(F)\T(F)) = 1, hence the integral over y yields 



Zy(v,c)o{F)\U{V,q) 

Note that T{F) n F^ = Zu(y,g)o(F) C {±1} (as subgroups of GL(i7)) in each case. Put 
t := [{±1} : Z'[j(y^qY{F)] which equals 2 in the odd orthogonal case, otherwise it equals 1. The 
integral over x yields 

/ y, ^7r(a)~ f^{cix~ 5x) dx 

= t- I I Yl ojn{a)~^f{az-^x-'^6x)dzdx 

T{F)F>^\GL{H) {±l}\Fx oi^F-^/F-^^ 

= t\2\p^ I [ Un{zy^f{zx-^6x)dzdx 



T(F)Fx\GL(H)Fx 

= t|2|-^ / fi{x-'^6x)dx = t\2\-^ / fi{x~'^6x)dx 

T{F)Fx\GL(_H") Fx\GL{H) 

using the fact that Ad s{z) = z^^ and wj = 1. 



Summing over T gives RewiP , fu) = ReSs=o Xlfclo 9^^'''''''^^ where 

hm ak = y^a^ = t\2\-^ R^'^ih , U) . 



fc— >oo 

T 



To relate the residue at s = and limfc_>oo «fcj it remains to apply [291 Proposition 6]. D 

Now return to the study of R . 
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Lemma 6.4.3. We have 

d{iT)d{a) ^ J 

^ T{F) 

r,og,cii(u(y,g)°) 

where c= 1 in the symplectic case, and c = 2 in the even or odd orthogonal cases. 

Proof. To begin with, we replace the integral over Zu/y^g\o{F)\\J(V,q) in R by an integral 
over Zu(y,<j)o(-^)\U(y,(?)° at the cost of introducing c. This is feasible as conjugating 7 by an 
element oi'[J{V,q) amounts to conjugating 6 by GL{H,F), by (pT]) . 

In view of the ellipticity of 7 and 5 (Corollary I6.2.4p . the first equality follows by applying 
Proposition 13.3.2] to \]{V,q)° and GL(//), while the second follows from our definition of the 
measure on ri.eg,eii(U(y, g)°) in (f2T]l . D 

In the next subsection, we will investigate the even orthogonal case dim^? V = 2n, under the 
hypothesis that n does not come from S0(2n + 1) by endoscopic transfer. 

6.5 The pairing for even orthogonal groups 

The Goldberg-Shahidi-Spallone formalism is now specialized to the even orthogonal case. As- 
sume that dinii? Vi = 6n, dim^? F = dimp H = 2n. In this case vr ~ vr^. Set G := SO(y,q), 
thus a £ U2{G). 

Since vr G nsc,temp(GL(i:/')) C Il2,temp{GL{H)) , we have (j) -^ n for some selfdual L-parameter 
4> G <I>eii,bdd(GL(i7)) which is irreducible as a representation of WDj?. By p!7|) . either 

1. sgn{(j)) = —1, hence vr comes from S0(2n + 1), or 

2. sgn((/)) = 1, hence vr comes from a unique elliptic endoscopic group G' = SO(y, q'), where 
{V', q') is an F-quadratic space with dimj? V' = 2n. 

Hypothesis 6.5.1. Assume vr does not come from S0(2n + 1). 

In Theorem l5.2.1l we have constructed a subset II^ C Il2{G') and a distribution Q9 on G'. 
Let s be the nontrivial element in Out2n(G'). In view of (j24p . it satisfies 

where v is any inverse image of v in 112 (C). In particular, ©9 is a virtual character of G' and 
one can define the multiplicity 

^^^^^ ^ ^_f2.(thecoefflcie„.ofe?meJ), if G = O'. 

^ ^ ^ ' \0, ifG/G', 

which belongs to {0, 1,2}. 

Theorem 6.5.2. Under the Hypothesis 1 6. 5. 1\ we have 

R''\h, U) = ^-jfT^ ■ 7V..(2(-1)» • mult(cT : 0) 
d{TT)d[a) 

for all fji G •A.{tt), fa G A{a). In particular, R \fji, f^) is not identically zero if and only if tt 
comes from G and the Oui2n{G)-orhit of a is contained II,^. 
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Bonus: it follows immediately that i?°^^ does not depend on the choice of X E lsom.p{V, H^). 
Proof. In view of Lemma 16.4.31 it suffices to show that 

j /^(a,7)/^L(/f)(~^^)^^ ^ 7^^(2(-l)» • 2-imult(cT : </.). 

rrog.cluG) 

Upon restriction to an open dense subset of ri.eg,eii(G), one may assume that 7 and 5 = Sxin) 
are both very regular semisimple. By Theorem 15.3.31 we have 

I^^i^){^,6)= J2 5^'(0,7')Aa(7','5). 

7'eA,,g,,n(G') 

Since 6 — > 7, Corollary 16.2.51 affirms that 6 corresponds to 7"^ € GrcgiF) by twisted 
endoscopy. If G 7^ G', no 7' G Ai.cg,cii(G') can correspond to 6 according to Lemma r4. 3. 11 hence 

Thus we may suppose G = G'. Again, Lemma 14.3.11 affirms that 7"^ represents the unique 
class in Ai.eg,eii(G') corresponding to 5, hence 

/^((j,7)/^(^)(v^,5)d7= j /^(a,7)S^(0,7~')AA(7"\5)d7 

rrog,cll(G) rr(,g,oll(G) 

= 7^,(2(-l)"g) J /^(a,7)5^(</),7"')d7 

rrog,cll(G) 

= 7V>^(2(-1)>) J /^(a,7)S<^(</',7)d7, 

rrog,cll(<-') 

by Corollarv 16.3.11 To get the term 2~^mult(o" : i;^), it remains to apply Schur's orthogonality 
relations for 112 (G): see [5l Theorem 3]. D 

This justifies [51 Definition 5.1], as promised. 

Remark 6.5.3. In |31j, Spallone also considered the broader setting in which SO{V,q) is not 
necessarily quasisplit. It seems that our arguments can be adapted accordingly, once Arthur's 
endoscopic classification in the non-quasisplit case is completed: see [3l Chapter 9] for an 
announcement of his results. 
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